-- Logs begin at Wed 2022-08-31 12:15:56 UTC, end at Wed 2022-08-31 13:18:11 UTC. -- Aug 31 12:45:30.743864 dv-cinder-854428-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 12:45:30.751169 dv-cinder-854428-2-smb devstack@keystone.service[81496]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:45:30 2022] *** Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: nodename: dv-cinder-854428-2-smb Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: machine: x86_64 Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: clock source: unix Aug 31 12:45:30.753166 dv-cinder-854428-2-smb devstack@keystone.service[81496]: pcre jit disabled Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: detected number of CPU cores: 4 Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: current working directory: / Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: your processes number limit is 47680 Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: your memory page size is 4096 bytes Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: detected max file descriptor number: 2048 Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: lock engine: pthread robust mutexes Aug 31 12:45:30.753637 dv-cinder-854428-2-smb devstack@keystone.service[81496]: thunder lock: enabled Aug 31 12:45:30.760719 dv-cinder-854428-2-smb devstack@keystone.service[81496]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 12:45:30.760719 dv-cinder-854428-2-smb devstack@keystone.service[81496]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:45:30.803487 dv-cinder-854428-2-smb devstack@keystone.service[81496]: Python main interpreter initialized at 0x562906fc39c0 Aug 31 12:45:30.803487 dv-cinder-854428-2-smb devstack@keystone.service[81496]: python threads support enabled Aug 31 12:45:30.803487 dv-cinder-854428-2-smb devstack@keystone.service[81496]: your server socket listen backlog is limited to 100 connections Aug 31 12:45:30.803487 dv-cinder-854428-2-smb devstack@keystone.service[81496]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:45:30.803876 dv-cinder-854428-2-smb devstack@keystone.service[81496]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:45:30.803954 dv-cinder-854428-2-smb devstack@keystone.service[81496]: *** Operational MODE: preforking *** Aug 31 12:45:30.804218 dv-cinder-854428-2-smb devstack@keystone.service[81496]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:45:30.804218 dv-cinder-854428-2-smb devstack@keystone.service[81496]: spawned uWSGI master process (pid: 81496) Aug 31 12:45:30.804429 dv-cinder-854428-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 12:45:30.805179 dv-cinder-854428-2-smb devstack@keystone.service[81496]: spawned uWSGI worker 1 (pid: 81512, cores: 1) Aug 31 12:45:30.807013 dv-cinder-854428-2-smb devstack@keystone.service[81496]: spawned uWSGI worker 2 (pid: 81513, cores: 1) Aug 31 12:45:30.807013 dv-cinder-854428-2-smb devstack@keystone.service[81496]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:45:35.188547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:45:35.188547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: from cryptography.utils import int_from_bytes Aug 31 12:45:35.189287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:45:35.189287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: from cryptography.utils import int_from_bytes Aug 31 12:45:35.189422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:45:35.189422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: from cryptography.utils import int_from_bytes Aug 31 12:45:35.189422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:45:35.189422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: from cryptography.utils import int_from_bytes Aug 31 12:45:35.240182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:45:35.240353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:45:35.240434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:45:35.240508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:45:35.240638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] command line args: [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:45:35.240717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] command line args: [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:45:35.240899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:45:35.240986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:45:35.241062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ================================================================================ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:45:35.241137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ================================================================================ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:45:35.241313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] admin_token = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.241403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] admin_token = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.241620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_dir = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.241698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_dir = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.241818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.241902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_source = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_source = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] debug = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] debug = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.242986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_config_append = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_config_append = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.243972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_dir = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_dir = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.244822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.245907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.246960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.247967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.248997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] publish_errors = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.249935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] publish_errors = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.250900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] standard_threads = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] standard_threads = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.251993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_journal = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_journal = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_json = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_json = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_stderr = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_stderr = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.252968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_syslog = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.253081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_syslog = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.253191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.253302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:45:35.253419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.253546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.253676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.253789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.253906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.254956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.255984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.256901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.257996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.258878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.259892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.260916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.261952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.262980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.263962 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.264991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.265920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.266931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.267971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.268911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.269975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.270087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.270741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.270869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.270983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.271990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.272971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.273921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.274827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.275934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.276906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.277936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.external = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.278781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.external = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.password = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.token = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.279976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.password = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.token = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.280892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.281966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.282882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.283914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.284910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.285730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.286477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.286599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.286712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.286823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.286937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.287974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.288890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.289935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.290956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.291986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.292854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.293924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.294999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.295911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.296936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.297995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.298913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.299978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.300916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.301906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.302887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.303974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.304988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.305930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.306887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.307909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.308934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.309938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.310958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.311955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.312977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.313924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.314945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.315978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.316999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.317966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.318977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.319925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.320955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.321990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.322914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.323961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.324896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.325954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.326979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.327888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:45:35.328793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:45:35.328793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:45:35.358656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.358833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.358918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.359043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.359123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.359282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.367901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.367998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.396652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.396880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.396963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.397149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.451718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.451981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.501724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.501958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.502245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.502482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.662994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.663131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.663223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.663347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.687211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.687434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.687653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.687785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.687880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.688879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.689094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.699306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.700446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.712644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.712895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.713943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.714024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.714162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.714376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.714585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.714795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:45:35.731509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.731719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:45:35.731888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.732065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.732151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:45:35.732270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:45:35.732422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.732545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.732629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:45:35.732809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.732907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.733074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.733166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.733361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.733625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.733711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.743751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.744898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.751540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.751907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.754518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.754876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.754999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.755994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.756943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.757072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.757328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.757410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.757702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.757981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.779901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.780785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.781343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.781648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.782297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.782585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.786686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.787042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.787323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.787818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.788107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.788394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.793810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.794096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.795056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.795342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.798327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.798616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.798898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.799180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.799452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.799545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.799751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.800039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.800324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.800603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.800881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.801156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.801437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.801580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.802287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.802566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.817912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.818186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.819171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.819454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.822032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.823341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.825104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.825397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.826586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.826889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.829736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.831120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.832865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.834509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.836095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.836680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.836961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.837239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.837638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.837788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.838092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.838383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.838672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.838954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.839235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.853948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.854230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.854495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.854756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.855814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.856106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.856376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.856642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.861431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.863095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.863576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.865209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.865478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.865812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.867385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.867665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.868125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.868406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.868685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.868967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.869268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.870359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.870648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.871040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.871330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.871642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.880651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.880930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.881211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.881503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.881791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.882074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.882357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.882858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.883144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.883522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.883809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.884096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.884389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.884682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.897703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.900244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.900696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.903185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.903569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.905004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.906101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.906503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.906787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.907076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.907556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.909173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.909457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.909780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.914335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.915747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.917039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.918570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.918655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.918900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.919183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.919453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.921847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.922144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.922434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.922714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.928196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.928479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.928755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.931330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.931625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.931910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.935640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.935922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.936201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.936474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.936746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.937016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.937301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.937601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.937881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.938159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.938426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.938684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.938851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:45:35.938944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.939138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.939221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.939423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.939701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.939977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.940253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.940540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.940819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.941099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.941389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.941773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.942593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.943025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.943308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:45:35.974553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562906fc39c0 pid: 81513 (default app) Aug 31 12:45:35.977971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a15f-0025-47b2-ba88-b06dea6a2bbc None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:35.978064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562906fc39c0 pid: 81512 (default app) Aug 31 12:45:35.978254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a15f-0025-47b2-ba88-b06dea6a2bbc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:35.978521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a15f-0025-47b2-ba88-b06dea6a2bbc None None] PATH_INFO: `/v3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:35.982615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Aug 31 12:45:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:42.550089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:42.550568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:42.550568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:42.555460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:45:42.560800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:42.561229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:42.561367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:42.632471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: INFO dbcounter [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] Registered counter for database keystone Aug 31 12:45:42.651510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG oslo_db.sqlalchemy.engines [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:45:42.657550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writer thread running {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:45:42.839801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG passlib.handlers.bcrypt [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81513) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:45:42.840192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG passlib.handlers.bcrypt [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81513) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:45:42.898121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:42.899694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:43.030150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 12:45:43.521178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:43.590184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: INFO dbcounter [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] Registered counter for database keystone Aug 31 12:45:43.611942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG oslo_db.sqlalchemy.engines [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:45:43.618892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writer thread running {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:45:43.736231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514ddd9-4f3a-48df-9bf8-0280acbe1417 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:43.740996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:43.741638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:43.741915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:43.742184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:43.750069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:43.801739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:45:43.802123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4bd7-13db-4cd9-a375-9b5680749bd5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:43.811600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 31 12:45:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:45:43.818313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:43.833259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b34610-d0ce-43da-ab34-ab485ce3af97 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:43.837729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:43.838808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:43.839091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:43.839372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] PATH_INFO: `/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:43.840940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb4fc2fc9f544519a9c90c5e72e0d4c0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:43.893258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING keystone.common.rbac_enforcer.enforcer [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:45:43.893625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f63d5-0405-4048-9027-bcc6716ec665 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:43.898755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Aug 31 12:45:43 2022] GET /identity/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:45.756340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d711c5-edf0-41c1-9924-2ee33604bc9b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:45.756919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d711c5-edf0-41c1-9924-2ee33604bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:45.756919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d711c5-edf0-41c1-9924-2ee33604bc9b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:45.760943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:45.766198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:45.766632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:45.766726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:45.787879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:45.789380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:45.797462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 12:45:46.064048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d711c5-edf0-41c1-9924-2ee33604bc9b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:46.082048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d711c5-edf0-41c1-9924-2ee33604bc9b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:46.086744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:46.087335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:46.087614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:46.087882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:46.095520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:46.097289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8675489-e6cb-4322-b451-90b22e45c838 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:46.107178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 31 12:45:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:45:46.112722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:46.126800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2e7e9-b427-44a0-89d4-a96249061706 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:46.131623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:46.132248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:46.132526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:46.132800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:46.134154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:46.136007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06c79-8c54-4a0a-8c54-59b934805318 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:46.137544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Aug 31 12:45:46 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:48.115325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85d81-48f5-4a14-9840-57f28d4d8891 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.115766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85d81-48f5-4a14-9840-57f28d4d8891 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.115875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85d81-48f5-4a14-9840-57f28d4d8891 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.117190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:48.122214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.122593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.122764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.141197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:48.142502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:48.200575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f1b7-5346-45f3-b93d-d6c676411b6c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.200857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f1b7-5346-45f3-b93d-d6c676411b6c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.201132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f1b7-5346-45f3-b93d-d6c676411b6c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.202478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:45:48.207461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.207743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.208016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.222390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:48.250218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG passlib.handlers.bcrypt [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81512) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:45:48.250618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG passlib.handlers.bcrypt [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81512) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:45:48.299662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:48.301245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:48.402200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:45:48.495283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:48.520980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:48.602509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f267e9-840b-41fc-9029-fa25918b7761 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:48.635578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:48.636222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.636503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.636779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.647704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:45:48.656530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:45:48.657618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:45:48.658640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:45:48.666034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:48.669284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:48.750870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:48.766860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2312cf-9fc3-48ec-8ee4-28e29710dc97 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:48.768946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3a4e-349a-4dae-baf4-7bdc701b09fc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:48.769149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:48.804145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:48.804748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.805026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.805293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.805749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:48.806594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.806874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.807146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.807973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:48.808274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:48.809704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:48.821193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:48.826789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:48.871933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:48.873672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:48.923036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226ced-4a3f-4610-a437-67adb22a0d76 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:48.953053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:48.955390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:48.956222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:48.956500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:48.956776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:48.958260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:48.960226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:48.961816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 9/16] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:48.967377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:48.973787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:45:48.979772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:49.003671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:49.070786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dbc07-157f-4b72-bd22-9fca6cd4812a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:49.076213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1823-ddd6-4118-95b7-e94cae43edb4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:49.105452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:49.106118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:49.106428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:49.106704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:49.107827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:49.109292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:49.110895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:49.116002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:49.116629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:49.116840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:49.117248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:49.117248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:49.126992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:49.128433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:45:49.143919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:45:49.145050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:45:49.146758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:45:49.146758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:45:49.146758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:45:49.146758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:45:49.151392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:49.185328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:49.219087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511fce7-9f61-4235-8d69-43b5d940d80c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:49.220687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:49.252178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d860-29cb-4bff-9e44-fdb19f3a22d6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:49.253889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:49.254497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:49.254776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:49.255052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:49.255805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.domain.id=default, user.id=fe6635e8dd81449693cd6bc25f154f24) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:49.256183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:49.257661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d648d-1370-4c3d-9e5b-be3519d8bd21 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:49.266119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 31 12:45:49 2022] GET /identity/v3/role_assignments?user.id=fe6635e8dd81449693cd6bc25f154f24&scope.domain.id=default&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:49.285837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:49.286463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:49.287427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:49.287668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:49.288319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:49.288616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:49.290079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930a30f-85ac-40b9-b357-d02df545de87 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:49.309630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:51.507441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3dc4-1255-447b-8e21-48ddc317ecc2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.508419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3dc4-1255-447b-8e21-48ddc317ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.508898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3dc4-1255-447b-8e21-48ddc317ecc2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.510486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:51.515913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a359-b8c2-40d1-8553-1aaa21724e12 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.516314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a359-b8c2-40d1-8553-1aaa21724e12 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.516458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a359-b8c2-40d1-8553-1aaa21724e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.542654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2324a359-b8c2-40d1-8553-1aaa21724e12 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:51.544157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2324a359-b8c2-40d1-8553-1aaa21724e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:51.635744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:51.826691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26b6a-663b-49a0-9709-c4e73d87441f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.826930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26b6a-663b-49a0-9709-c4e73d87441f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.827160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26b6a-663b-49a0-9709-c4e73d87441f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.828488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:51.834238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401b6-5976-48dc-88fe-6fce9502882b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.834532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401b6-5976-48dc-88fe-6fce9502882b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.834809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401b6-5976-48dc-88fe-6fce9502882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.858088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-65b401b6-5976-48dc-88fe-6fce9502882b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:51.859294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-65b401b6-5976-48dc-88fe-6fce9502882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:51.887717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:51.920101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ab23-f9a3-4980-a357-03e34a2cfc66 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.920650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ab23-f9a3-4980-a357-03e34a2cfc66 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.921080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ab23-f9a3-4980-a357-03e34a2cfc66 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.922599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 14/25] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:51.928567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbd23-de3b-4532-b7ad-44d68f28124e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:51.929103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbd23-de3b-4532-b7ad-44d68f28124e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:51.929899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbd23-de3b-4532-b7ad-44d68f28124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:51.964404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-364cbd23-de3b-4532-b7ad-44d68f28124e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:51.965915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-364cbd23-de3b-4532-b7ad-44d68f28124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:51.987579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:52.088595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:45:52.220155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186efe1-0aca-4102-ad91-2187f5e23ec8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:52.220805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186efe1-0aca-4102-ad91-2187f5e23ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:52.221287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186efe1-0aca-4102-ad91-2187f5e23ec8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:52.222927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 13/28] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:52.228887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:52.229179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:52.229457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:52.253512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:52.254716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:52.336085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186efe1-0aca-4102-ad91-2187f5e23ec8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:52.358687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:52.440865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:52.490367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:52.492882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186efe1-0aca-4102-ad91-2187f5e23ec8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:52.558925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:52.559544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:52.559824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:52.560097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:52.583029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:52.585184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:52.605880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed044f-8577-491e-a5ac-dd0576d406cc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:45:52.612893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:45:52.613970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:45:52.615442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:45:52.615442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:45:52.615442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:45:52.615442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 14/30] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:45:52.622121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:52.640589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:52.658415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:52.659320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:52.659752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:52.660162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:52.660981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:52.662923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:52.802939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89cfe-6ecc-4096-9979-fa319f371e7e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:52.835866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 17/31] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 12:45:52 2022] POST /identity/v3/roles => generated 219 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:45:52.836698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:52.841195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:52.842201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:52.842805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:52.843227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:52.857301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:45:52.863733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:45:52.864642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:52.865397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:45:52.868396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 15/32] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:45:52.874129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:52.953528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:52.956192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:52.983211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c5a7-d67f-4f58-bc99-c4d11af7f02f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.004152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d522a6c-d363-4afb-b215-2a043b2c034b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.029857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.030483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.030815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.031092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.031884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:53.032040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.034182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.048946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.049899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.050367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.050801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.051664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.054006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530ea31-f93e-4601-b4b6-bc5c498e5232 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.059016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 18/33] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:53.063874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.172394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593f26b-832e-46d3-ac34-b53a277f19e0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.184323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 16/34] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 12:45:52 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:45:53.185803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740e74-b16a-445e-90a5-998e550d3d64 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.186109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740e74-b16a-445e-90a5-998e550d3d64 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.186383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740e74-b16a-445e-90a5-998e550d3d64 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.187797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 17/35] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:53.188314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740e74-b16a-445e-90a5-998e550d3d64 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.215938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.217128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.217673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.218520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.219745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:53.220381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db34c2-d2c9-4ca2-a702-49c7c1e1264b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.235493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 19/36] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:53.237925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51673-d04a-48b0-87ba-71897a9e2155 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.238487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51673-d04a-48b0-87ba-71897a9e2155 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.238935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51673-d04a-48b0-87ba-71897a9e2155 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.241658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 20/37] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:53.243343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.243631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.243907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.263136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:53.264726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:53.267227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:53.315007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740e74-b16a-445e-90a5-998e550d3d64 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.346918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:53.349724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 21/38] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:53.350587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.367348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.368449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.368660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.369625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.369625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.371283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e20f5d-5746-4725-af0b-07b66f676ab5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.405386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 18/39] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:45:53 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:45:53.406740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.407070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.407410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.475371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9709-2ca2-4359-8422-d5522bea032b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.518810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.519895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.520372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.520857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.522717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.524451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.529542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 22/40] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:45:53 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:53.532458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.546906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:53.569219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:53.570952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:53.659733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 19/41] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:53.659733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.660511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f548dc-1d6e-4f04-825f-cdde1def1473 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.699693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.700364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.700648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.700927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.702085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.703568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.705170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 23/42] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:53.711369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:53.770572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8311f1-1e44-4671-9a9e-25c7bb805135 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.780324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:53.797606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:53.810447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.811290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.811787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.812198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.813031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.814588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.825264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e82bf-25e6-4a71-8d8c-17884c7769c7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:53.830776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 20/43] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 12:45:53 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:45:53.862554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:53.863237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:53.863520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:53.863801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] PATH_INFO: `/v3/domains/default/users/fe6635e8dd81449693cd6bc25f154f24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:53.866498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fe6635e8dd81449693cd6bc25f154f24, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:53.867965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:53.884367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 24/44] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Aug 31 12:45:53 2022] PUT /identity/v3/domains/default/users/fe6635e8dd81449693cd6bc25f154f24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:45:53.938548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:54.054271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232446-09a2-47f6-b28c-871d72973b03 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:54.088948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:54.089627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:54.089967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:54.090181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:54.091299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:54.092745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8476af6-972d-4180-a446-10b448a7820a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:54.094573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 21/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:54.103180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:54.201350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d9e4-afbc-4c47-9e5e-9c641f9ea5d7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:54.235238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:54.235849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:54.236131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:54.236408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:54.237065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:54.238537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca14dbd-a289-41f7-94ab-189ccd3a5c58 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:54.243897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:54.272935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 25/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:45:54 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:45:55.837075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec35-30cb-428c-bf8d-cd8b3e8ab1e9 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:55.837623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec35-30cb-428c-bf8d-cd8b3e8ab1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:55.837623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec35-30cb-428c-bf8d-cd8b3e8ab1e9 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:55.838987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 22/47] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:55.844314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe17c3-2408-40b8-9e92-61d0a55fdc0d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:55.844720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe17c3-2408-40b8-9e92-61d0a55fdc0d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:55.845006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe17c3-2408-40b8-9e92-61d0a55fdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:55.863646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e7fe17c3-2408-40b8-9e92-61d0a55fdc0d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:55.865551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e7fe17c3-2408-40b8-9e92-61d0a55fdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:55.933734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 26/48] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:56.203166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ec35-30cb-428c-bf8d-cd8b3e8ab1e9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.240686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:56.307481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ec35-30cb-428c-bf8d-cd8b3e8ab1e9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.315842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037a0-91df-4c65-b1ef-cce106d765a4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.316265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037a0-91df-4c65-b1ef-cce106d765a4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.316618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037a0-91df-4c65-b1ef-cce106d765a4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.318786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 27/49] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:45:56.323668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.324039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.324387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.342302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:56.342984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.343524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:56.343616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.343886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.344164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.354603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:45:56.359440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:45:56.360241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:45:56.360973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 23/50] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:45:56.367137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.410556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 28/51] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:45:56.463354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:56.469759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43a818-3b64-4e68-8c49-be03c4b2f81d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.504948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.506219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.506490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.506759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.507415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:56.507711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:56.509079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:56.521274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 24/52] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:56.526789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.572934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:56.625774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea6cf1-9bc9-4e47-aba5-c00ba15fff55 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.658142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.658761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.659046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.659318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.660510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:56.662526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:56.664239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 29/53] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:56.670023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.680801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.770222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc967de-95e5-4912-9822-85eb3fb584a1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.776930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00700fc-d31c-4327-8da5-03fddd2dbf64 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.791528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:56.804779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.805409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.805713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.805983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.807077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:56.808510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:56.816505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 25/54] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:56.816627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.816627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.816627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.816627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.816936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:56.817564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.817950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:56.819565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 30/55] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:56.824701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:56.844426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:56.917941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3438-eee5-4733-b5bc-3e0008431c17 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.923973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eda30-25a9-4ce9-868d-7e5dc995bc11 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:56.952719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:56.953350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:56.953669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:56.953948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:56.954704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.domain.id=default, user.id=fe6635e8dd81449693cd6bc25f154f24) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:45:56.955015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:56.956515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57124a5-ec13-4105-a604-ccb67255b68e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:56.965243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 26/56] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 31 12:45:56 2022] GET /identity/v3/role_assignments?user.id=fe6635e8dd81449693cd6bc25f154f24&scope.domain.id=default&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:45:57.068064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:57.068687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:57.068967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:57.069241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:57.069939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:57.071943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381674a-f0c6-4378-b832-9e6cf53ac9eb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:57.104288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 31/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 31 12:45:56 2022] POST /identity/v3/projects => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:45:59.004216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a08c-94a8-48da-9f27-2574240086c1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:59.004761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a08c-94a8-48da-9f27-2574240086c1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:59.004761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a08c-94a8-48da-9f27-2574240086c1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:59.006754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 27/58] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:45:59.011908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:59.012320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:59.012462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:59.030689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:45:59.031883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:45:59.057581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:59.097563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 32/59] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:45:59.365419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a08c-94a8-48da-9f27-2574240086c1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:59.455632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:59.466431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a08c-94a8-48da-9f27-2574240086c1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:59.498971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:59.499593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:59.499869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:59.500136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:59.501235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:59.502712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6b06-6ba5-4be5-b4fd-9be6d35185da None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:59.504248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 28/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:45:59.509772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:45:59.604683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb614ea-65ad-4f4e-8f34-d4dc171d2ad1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:45:59.637158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:45:59.637716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:45:59.638001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:45:59.638275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:45:59.638926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:45:59.640348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015ad5-d73a-4894-9470-5375ed58cf3b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:45:59.666954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 33/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:45:59 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:02.823672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e869e-8392-4d79-87b2-776fc21dc3d3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:02.824669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e869e-8392-4d79-87b2-776fc21dc3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:02.825147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e869e-8392-4d79-87b2-776fc21dc3d3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:02.826836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 29/62] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:02.828978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42fb-394c-408b-a5df-43458aef5cf4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:02.829809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42fb-394c-408b-a5df-43458aef5cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:02.830281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b42fb-394c-408b-a5df-43458aef5cf4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:02.832017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 34/63] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:02.833455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378729-7dc4-4934-b192-a8a1cfe78971 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:02.833996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378729-7dc4-4934-b192-a8a1cfe78971 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:02.834459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378729-7dc4-4934-b192-a8a1cfe78971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:02.842716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f6df-9c2f-45fb-a341-79ae4ce7e9b0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:02.843233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f6df-9c2f-45fb-a341-79ae4ce7e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:02.843702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f6df-9c2f-45fb-a341-79ae4ce7e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:02.871978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8ef4f6df-9c2f-45fb-a341-79ae4ce7e9b0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:02.874824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8ef4f6df-9c2f-45fb-a341-79ae4ce7e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:02.881932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4d378729-7dc4-4934-b192-a8a1cfe78971 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:02.884260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4d378729-7dc4-4934-b192-a8a1cfe78971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:02.905929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.022132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:03.027034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897486-680d-4533-a346-b6783062697e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.027492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897486-680d-4533-a346-b6783062697e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.027948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897486-680d-4533-a346-b6783062697e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.029269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 36/65] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:03.033089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 30/66] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:03.034177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.034465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.034741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.070508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:03.071712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:03.080916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af85d-9a04-47e4-9a58-c5fa789a4a83 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.081446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af85d-9a04-47e4-9a58-c5fa789a4a83 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.081940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af85d-9a04-47e4-9a58-c5fa789a4a83 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.083640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 31/67] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:03.092672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.093599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.094069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.124023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:03.127937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:03.215623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 37/68] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:03.228791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 32/69] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:03.339325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.370153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.402882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.438402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.459629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f6a1-73b5-4ed4-a67e-9e2b017323ae None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.497179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.498434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.498906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.499365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.511517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ca319-f533-4b40-8d6b-5ad4baa79b54 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.511993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-57168a85-f9a6-42b1-82ec-31b61000a098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:03.522009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:03.522872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:03.523612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:03.526029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 38/70] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:03.527247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4060d-37dd-498b-b4ee-4829effc6891 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.527524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4060d-37dd-498b-b4ee-4829effc6891 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.527932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4060d-37dd-498b-b4ee-4829effc6891 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.529312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 39/71] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:03.530141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4060d-37dd-498b-b4ee-4829effc6891 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.555390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.556022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.556309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.556560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.567058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:03.572431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:03.573298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 33/72] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:03.575075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.636398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4060d-37dd-498b-b4ee-4829effc6891 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.656939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.669968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.670700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.671098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.671375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.678915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.679381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6571-2fc5-4eb8-b3f1-1818dff4a596 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.682445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-09fdfd5c-60f1-4808-8795-6bf1f3e166f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:03.687564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:03.688418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:03.689160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:03.689759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 40/73] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:03.691208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.691488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.691822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.710020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:03.711183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:03.715721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.716331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.716617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.716897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.717599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:03.717909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:03.719293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:03.727929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 34/74] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:03.727929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.788406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 41/75] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:03.789242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.834695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fdb86-74cf-4048-a768-eb7141c3f3ec None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.869461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.870095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.870562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.870990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.871669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:03.871974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:03.873521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:03.881670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 35/76] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:03.882550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.885150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.899903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e1909-5ada-4ad3-b913-ecc25b2e3ebe None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:03.930338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:03.937793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:03.938431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:03.938716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:03.938997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:03.949647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:03.954613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:03.955440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 42/77] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:03.957639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:03.999492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9f49a-47ba-4ac1-a090-d9f57b65f071 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.037148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.037967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.038252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.038529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.039197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:04.039498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.040868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.053992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 36/78] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.053992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.067656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b112-4406-4ac2-82e2-6905e6e76dfa None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.108319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.108952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.109235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.109531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.110676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.112123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.113814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 43/79] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:03 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.114611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.119194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.159230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9c76-0da9-4a75-b397-4032835a20e2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.174845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.193608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.194239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.194571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.194849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.207869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.210056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.211778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 37/80] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.213637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.218088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fc546-c4bf-43d9-8d03-0706aa593db1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.250394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.250990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.251265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.251533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.252189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:04.252486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.253867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.262369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 44/81] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.263134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.315912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3c661-ae61-44bf-b769-45ac6993d1be None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.338781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.351679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.352315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.352588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.352858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.354006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.355450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.357015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 38/82] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.357796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.363476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4f6ad-4bfb-47bb-a0b5-d881a3057685 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.383467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.397712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.398347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.398607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.398880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.399984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.401402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.402970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 45/83] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.403715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.457199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b353b-302d-46c2-bdd4-2ce5d61beeb8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.493892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.494495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.494776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.495048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.506667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ddafc-118e-4631-beca-9d93a5cf70b8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.540887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.541515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.541793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.542075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.554765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.565420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.566935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.597163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.609234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.610731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.664589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 39/84] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:04.666484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.708649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 46/85] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:04.709941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.761639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.771883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6b248-4089-4036-bc74-01384ee7f05c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.795954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:04.805799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.806503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.806852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.807194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.807993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b12e8-297c-4e29-b794-85ab4c1a417a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.808450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.809988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.811551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 40/86] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:04.816590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:04.844059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.844659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.844939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.845210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.911553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff1e8b-f4e4-41fb-88f4-f72bc6ea3faf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:04.914566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.916299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.945753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:04.946367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:04.946651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:04.946930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:04.947587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:04.949031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:04.977111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 41/87] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:04 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:04.977723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.001434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.017938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.035563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 47/88] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:05.036709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.121455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa215b-6037-4332-98db-684ae3663c23 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.161601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3ac-e2c2-49a9-b69d-a64e51345a46 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.166387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.167036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.167315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.167592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.168727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.170478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.172107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 42/89] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:04 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.172868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.212682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.213424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.213823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.214617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.216063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.217985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.219580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 48/90] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.220196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.287619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.300645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.313135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c250c-69d6-4806-a6f0-b0d50616b1c8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.350332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.351069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.351351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.351627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.367593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f655ca-06d0-4136-890a-94feaa8b124f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.419621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.420701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.421088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.421500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] PATH_INFO: `/v3/projects/4ef5f9fb956f474da331eff8305f54f5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.423431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f9fb956f474da331eff8305f54f5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.425514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.428071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 49/91] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/projects/4ef5f9fb956f474da331eff8305f54f5 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.428858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.433441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.435135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.533705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.562857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a276ae-0728-47b1-b8f5-575b948e263c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.563035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 43/92] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:05.563752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.589067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.601936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.602547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.602831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.603089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.603830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=fe6635e8dd81449693cd6bc25f154f24) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:05.604351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.605656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.611827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 50/93] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/role_assignments?user.id=fe6635e8dd81449693cd6bc25f154f24&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.612622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.701091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12c2-9d7f-4a29-b527-40a6cc7060e4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.743300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.744560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.745086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.745667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.746636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:05.747151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.748851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.757353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 44/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.758823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:05.830046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:05.837409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213b24-b242-4277-87e9-906b263a9dc6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.876905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.878001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.878659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.879011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.880406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=4ef5f9fb956f474da331eff8305f54f5, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:05.880795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.882375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.889067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 51/95] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=4ef5f9fb956f474da331eff8305f54f5&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.893226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be25e-7d92-4870-b635-397f54f870ec None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:05.946324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:05.947079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:05.947261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:05.947528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:05.950309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:05.951842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff5a9-70fd-4bd7-bcdd-9dc5f6e53db1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:05.954054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 45/96] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:05.960416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:06.045117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:06.098305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be4ef-a9aa-4b2c-b8e3-faf0d624450c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:06.140841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:06.141499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:06.141790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:06.142069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:06.142836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:06.143149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:06.144813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a03be8-1df3-4c22-9354-2c0cad83a011 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:06.151705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 52/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:05 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:07.507420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e8595-bf10-4d89-b9a1-fb12d979294a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:07.507900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e8595-bf10-4d89-b9a1-fb12d979294a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:07.507900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e8595-bf10-4d89-b9a1-fb12d979294a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:07.509355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 46/98] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:07.514710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d529-e35f-443c-9959-29971d5fd7ae None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:07.515522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d529-e35f-443c-9959-29971d5fd7ae None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:07.516010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8d529-e35f-443c-9959-29971d5fd7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:07.536861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a5a8d529-e35f-443c-9959-29971d5fd7ae None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:07.538790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a5a8d529-e35f-443c-9959-29971d5fd7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:07.609277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 53/99] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:07.840525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270482-c86e-46b9-b806-525043894e52 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:07.841180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270482-c86e-46b9-b806-525043894e52 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:07.841714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270482-c86e-46b9-b806-525043894e52 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:07.843286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 47/100] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:07.850229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:07.850779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:07.851261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:07.878536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:07.880657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:07.931059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:07.971969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 54/101] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:07.974955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270482-c86e-46b9-b806-525043894e52 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:08.134277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270482-c86e-46b9-b806-525043894e52 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:08.150294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:08.180142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:08.180796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.181078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.181354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.182549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:08.184040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:08.185880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 48/102] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:08.191590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:08.289343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:08.352657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ae0f-3bb3-4279-abc6-ddeb9f972475 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:08.424822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bd16-449f-4d34-aa09-405d5494dc00 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:08.475007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:08.476009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.476519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.477004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.477908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:08.479567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd28c4-0e83-44e0-ae8d-4176a0e02616 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:08.482363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:08.483240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.483696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.484108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.503262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:08.514786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 55/103] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:46:08 2022] POST /identity/v3/projects => generated 302 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:08.516449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b13d17-53e6-473e-b79c-57883d9406da None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.516746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b13d17-53e6-473e-b79c-57883d9406da None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.517026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b13d17-53e6-473e-b79c-57883d9406da None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.520909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 56/104] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:08.521775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:08.522934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:08.523668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 49/105] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:08.526690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7574-9203-4fc1-b64b-f669ac55c2f6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.526984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7574-9203-4fc1-b64b-f669ac55c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.527267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7574-9203-4fc1-b64b-f669ac55c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.531002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:08.569034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b5df7574-9203-4fc1-b64b-f669ac55c2f6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:08.570317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b5df7574-9203-4fc1-b64b-f669ac55c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:08.619331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:08.621072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:08.710632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 57/106] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:08.711998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5f20-eb35-492b-ac5d-f3ddae7fb1df None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.712294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5f20-eb35-492b-ac5d-f3ddae7fb1df None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.712631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5f20-eb35-492b-ac5d-f3ddae7fb1df None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.714147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 58/107] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:08.719282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.719565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.719826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.735410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b2f6-6f99-4cf8-a897-0e7d45aa0f1d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:08.758278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:08.759509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:08.807271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:08.808603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:08.808888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:08.809166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:08.809889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:08.810198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:08.812438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:08.831586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 50/108] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:08.837531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:08.885434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 59/109] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:08.997401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ea54-884c-47e1-8d86-5b5b8a0576b7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.002492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.039112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.042486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.043607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.044067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.044584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] PATH_INFO: `/v3/users/9e23e91975c24d989ffa838bd02cf5c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.065805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] RBAC: Authorizing `identity:get_user(user_id=9e23e91975c24d989ffa838bd02cf5c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.067780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.070131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 51/110] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:08 2022] GET /identity/v3/users/9e23e91975c24d989ffa838bd02cf5c1 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:09.076766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.190164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.203492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056552a-8fbf-4368-b522-8c9fb2a65401 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.239573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.240215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.240547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.240828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.257653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:09.262734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:09.263579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:09.264321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 60/111] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:09.264943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.283178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472b11-9f06-4388-a198-a7b6f06f48da None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.321150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.322084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.322588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.323007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.357261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.372477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245bb7-2b0d-430c-954e-f409db84bcf2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.400365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.402115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.407971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.408604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.408882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.409155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.420666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5554d6a0-e22f-4d51-a9c8-901c71df29d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:09.426003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:09.427042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:09.427849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 61/112] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:09.428478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b99-ec6d-44ae-b969-35a6220a55ae None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.428821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b99-ec6d-44ae-b969-35a6220a55ae None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.428958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72b99-ec6d-44ae-b969-35a6220a55ae None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.435079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 62/113] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:09.439525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72b99-ec6d-44ae-b969-35a6220a55ae None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.448237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.526351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 52/114] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:09.526351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.557284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72b99-ec6d-44ae-b969-35a6220a55ae None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.588014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.593413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.594433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.594433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.594606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.595244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:09.595556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.596925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660caaa9-b5c2-423a-bfd4-1aef8f9294fa None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.606491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 63/115] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:09.607662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.607950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.608229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.626386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:09.627707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:09.637747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb483fb-a66e-43ea-9391-45e9fc72adfe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.680686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.681379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.681672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.681981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.682652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:09.682951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.684437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bf5e2-6f64-4a66-bd4a-7a5d39daa442 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.698532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 53/116] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:09.698532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e54ba-a542-4259-a0b1-d1f8d482b9ff None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.698532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e54ba-a542-4259-a0b1-d1f8d482b9ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.698532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e54ba-a542-4259-a0b1-d1f8d482b9ff None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.698532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 54/117] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:09.701349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e54ba-a542-4259-a0b1-d1f8d482b9ff None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.702577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.708597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 64/118] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:09.709877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.844902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e70f-3008-48da-a462-deec972a6634 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.849734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e54ba-a542-4259-a0b1-d1f8d482b9ff None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:09.881943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:09.886387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.887282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.887753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.888214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.889962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.893093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.893222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:09.893785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.894068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.894344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.896920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 65/119] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:09.897990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:09.900918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:09.902771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64180e3a-7565-417e-a68a-690e43733682 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:09.904397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 55/120] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:09.905472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:09.905776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:09.906051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:09.931762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:09.933068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:09.972337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.009072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0811-6671-427e-bfda-c9ef1a3da0f6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.011237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 56/121] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:10.012290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.050161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.051245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.051919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.052491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.053977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.055802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.057600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 66/122] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:09 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:10.058652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.128542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4007-75d5-40c3-bf75-a5abff8071c5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.155367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.168330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.169006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.169611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.169852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.170593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=9e23e91975c24d989ffa838bd02cf5c1) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:10.170896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.172519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.179335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 57/123] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/role_assignments?user.id=9e23e91975c24d989ffa838bd02cf5c1&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:10.181621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d4f89-18e1-4ba2-931a-d7e140ab9323 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.186569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.221759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.222765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.223293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.224289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.225832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.227585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.229648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 67/124] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:10.230627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.235106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.355053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dda71f-e05f-4d70-8f4e-4f38b9c19459 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.363032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7e0e-359c-4f9f-aa5a-7e465b557f2a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.403601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.404777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.404929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.405233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.420275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:10.420442 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.420978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.421253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.421557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.422707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.424141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.426118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 68/125] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:10.427750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:10.429461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:10.430294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:10.431020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:10.437664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 58/126] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:10.442503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.503271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.510341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.543538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d70f5c-878b-43cf-b1e0-642e61000a84 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.581381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac5ff-d598-418c-844e-69e1bdc1dbef None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.583093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.584326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.584810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.585276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/users/fe6635e8dd81449693cd6bc25f154f24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.587431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, user_id=fe6635e8dd81449693cd6bc25f154f24, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.589080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.605784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 69/127] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:10 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/users/fe6635e8dd81449693cd6bc25f154f24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:10.607545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.625255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.626163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.626541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.626936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.643203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:10.648855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:10.649792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:10.650571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 59/128] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:10.651195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.768211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f6ddb-dffa-4d69-9c75-aa7e91fd625c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.782077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41448524-12bc-43ef-8b9c-78e0c4b7a4f5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:10.793821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.810644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:10.829474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.830514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.832445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.833302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:10.833474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/users/74e95fb0b04948b3bae443ca4a948045/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.834475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:10.834979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:10.835475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:10.836429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:10.836930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.839758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.841456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, user_id=74e95fb0b04948b3bae443ca4a948045, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:10.845273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:10.851274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 60/129] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:10.852392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.886407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 70/130] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:10 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/users/74e95fb0b04948b3bae443ca4a948045/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:10.887246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:10.973108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361921-1a4b-461c-acac-dfbe20f49651 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.012176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.013250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.013752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.014236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.015207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:11.015721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.017340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f212-c05b-4a83-813b-6d9c464d4e7a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.027425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 61/131] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:11.028989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2eaa-6a38-4fdf-a428-612165d27e1c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.029528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2eaa-6a38-4fdf-a428-612165d27e1c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.029817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2eaa-6a38-4fdf-a428-612165d27e1c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.031164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 62/132] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:11.036855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.037166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.037593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.059209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:11.060425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:11.064837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1c2c1-2769-4bb9-a046-4f983367fda3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.088344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:11.139498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.140704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.140704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.140938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.142280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.142733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 63/133] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:11.143798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.145297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.149699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 71/134] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:10 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:11.156259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.252519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141200-a13b-48dc-ade0-ff37d4b0d65d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.292858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.293867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.294874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.295360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.296699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.300637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 64/135] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:11 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:11.305977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:11.307083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.338717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:11.387746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c21d-a45a-417d-ac46-00471dfb0c72 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.424236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44551-6575-46e2-a023-bda84b3f2664 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.461120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.461961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.462344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.462719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] PATH_INFO: `/v3/projects/4ef5f9fb956f474da331eff8305f54f5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.464053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f9fb956f474da331eff8305f54f5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.465650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.466192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.466846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.467133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.467411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.467774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 65/136] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:11 2022] GET /identity/v3/projects/4ef5f9fb956f474da331eff8305f54f5 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:11.473953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.474405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.475726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.477524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 72/137] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:11 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:11.483600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.577769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:11.585430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd79-e1da-4394-9c82-46c640510ffc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.622504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.623169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.623448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.623720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] PATH_INFO: `/v3/projects/4ef5f9fb956f474da331eff8305f54f5/users/74e95fb0b04948b3bae443ca4a948045/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.625649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ef5f9fb956f474da331eff8305f54f5, user_id=74e95fb0b04948b3bae443ca4a948045, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.627658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.653764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 66/138] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:11 2022] PUT /identity/v3/projects/4ef5f9fb956f474da331eff8305f54f5/users/74e95fb0b04948b3bae443ca4a948045/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:11.655392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:11.720440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852afb3-8523-4fa7-9c7c-ccc14058ee6f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.770096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:11.787245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.787979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.788264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.788540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/users/74e95fb0b04948b3bae443ca4a948045/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.791266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, user_id=74e95fb0b04948b3bae443ca4a948045, role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.792779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.857585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:11 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/users/74e95fb0b04948b3bae443ca4a948045/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:11.896096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07b8-e8a8-492b-9a29-2be64dc9c04f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:11.952771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:11.953414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:11.953724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:11.954002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:11.959183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:11.961391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cdf8c-27d0-408a-ab1d-7aa47e4edf23 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:11.963767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:11.968927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:12.078554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23bd22-3165-4cfb-ac55-2cd5ce94cf55 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:12.118002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:12.119033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:12.119550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:12.120010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:12.120869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:12.122502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c74c1-225d-40ec-89f5-830d5c2908d3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:12.147247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 74/141] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:11 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:46:13.163722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97656ba-76e0-494e-82e1-784adc1611ff None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.164215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97656ba-76e0-494e-82e1-784adc1611ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.164286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97656ba-76e0-494e-82e1-784adc1611ff None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.165913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 68/142] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:13.173380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91613f1-58c0-4881-beb9-beb28bfb996e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.173843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91613f1-58c0-4881-beb9-beb28bfb996e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.174021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91613f1-58c0-4881-beb9-beb28bfb996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.198456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d91613f1-58c0-4881-beb9-beb28bfb996e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:13.199648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d91613f1-58c0-4881-beb9-beb28bfb996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:13.243710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:13.276109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 75/143] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:13.388109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735a712-6055-4c71-953e-21ca0e87d0a2 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.388388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735a712-6055-4c71-953e-21ca0e87d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.388581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735a712-6055-4c71-953e-21ca0e87d0a2 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.389971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 69/144] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:13.395602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05104c-8abb-4f17-97d3-95c7812e0f51 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.395890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05104c-8abb-4f17-97d3-95c7812e0f51 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.396160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05104c-8abb-4f17-97d3-95c7812e0f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.422620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2d05104c-8abb-4f17-97d3-95c7812e0f51 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:13.423906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2d05104c-8abb-4f17-97d3-95c7812e0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:13.503018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 76/145] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:13.646597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735a712-6055-4c71-953e-21ca0e87d0a2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:13.673809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:13.766784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f40e1-9b7e-4690-a956-a0112cc35b82 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.767235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f40e1-9b7e-4690-a956-a0112cc35b82 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.767611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f40e1-9b7e-4690-a956-a0112cc35b82 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.769074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 77/146] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:13.772015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735a712-6055-4c71-953e-21ca0e87d0a2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:13.775664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.775952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.776230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.806343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:13.807616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:13.821170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:13.821987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:13.822267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:13.822535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:13.838642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:13.844478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:13.845303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:13.846059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:13.846618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 70/147] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:13.853707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:13.931896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 78/148] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:13.970297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:13.987498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433425e-d11c-4920-bde5-4a253242f329 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.024213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.024821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.025152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.025423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.026184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:14.026482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:14.027855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:14.040393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 71/149] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:14.046285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.111662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:14.196841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc469-f920-47cf-ac8c-8f0f79535810 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.243635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.244280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.244557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.244825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] PATH_INFO: `/v3/users/9e23e91975c24d989ffa838bd02cf5c1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.246024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] RBAC: Authorizing `identity:get_user(user_id=9e23e91975c24d989ffa838bd02cf5c1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:14.247502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:14.249108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 79/150] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/users/9e23e91975c24d989ffa838bd02cf5c1 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:14.253631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.254401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.433261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cb5e2-ec4b-4e2c-98fa-4e295b9d4a0a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.436310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:14.483628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7368-d389-4b31-922d-13b3cdd922cb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.512050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.512692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.512970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.513240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.515266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:14.516710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:14.518401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 80/151] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:14.525679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.567618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.568269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.568551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.568825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.602616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:14.608050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:14.608880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:14.609630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 72/152] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:14.614667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.649030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:14.675813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe75e-2062-433c-952c-cced519527d2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.754898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.755502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.755784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.756057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/users/9e23e91975c24d989ffa838bd02cf5c1/roles/38e85fc2129244bfab565b6aa7ed9acf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.758043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, user_id=9e23e91975c24d989ffa838bd02cf5c1, role_id=38e85fc2129244bfab565b6aa7ed9acf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:14.759489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:14.762620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa8f5-6801-48de-a452-1602a89394e1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:14.792271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 81/153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:14 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/users/9e23e91975c24d989ffa838bd02cf5c1/roles/38e85fc2129244bfab565b6aa7ed9acf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:14.793127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.807872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:14.808576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:14.808857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:14.809129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:14.821163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:14.826412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:14.827316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:14.828049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 73/154] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:14.835413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:14.852262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:14.938359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:15.023123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c6d5b-0bab-44d2-8009-04618640d613 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:15.083782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6837133-8bc4-4809-b850-835321933fc0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:15.142199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:15.142824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.143103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.143371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.144046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:15.144344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:15.145941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed6db5-dee9-49cf-bba2-2f98407c78d6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:15.163779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 74/155] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:15.164861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb927c-780c-407d-8207-6537c73a210c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.165141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb927c-780c-407d-8207-6537c73a210c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.165408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb927c-780c-407d-8207-6537c73a210c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.166769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 75/156] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:15.170289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb927c-780c-407d-8207-6537c73a210c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:15.188911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:15.189554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.189836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.190107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.190789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:15.191090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:15.193199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a576-53d9-477a-bae8-a596a8ef0497 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:15.212792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 82/157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:15.214073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.214363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.214638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.243609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:15.244805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:15.407726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 83/158] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:15.408825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:15.417248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb927c-780c-407d-8207-6537c73a210c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:15.454596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:15.469851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:15.483756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:15.484407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.484683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.484952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.488331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:15.491017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:15.492835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 76/159] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:15 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:15.498592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:15.662361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1842e6-b93a-4001-84b3-85f338979e93 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:15.711990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10920-e92b-4f2a-81fe-dec3f68451a1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:15.752985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:15.753657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.753939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.754215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] PATH_INFO: `/v3/users/fe6635e8dd81449693cd6bc25f154f24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.756040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6635e8dd81449693cd6bc25f154f24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:15.757506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:15.759296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 84/160] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:15 2022] GET /identity/v3/users/fe6635e8dd81449693cd6bc25f154f24 => generated 247 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:15.765550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:15.782794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:15.783896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:15.784179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:15.784466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:15.865269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:15.880016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:15.881580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bc819-c656-4038-b83f-32944b748e10 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:16.044560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:16.079604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92595-12bf-40e0-a2ea-d570520f65f0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:16.082872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 77/161] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:16.084158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf4bc-94f8-4530-bd2f-cf7f73353b92 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:16.084441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf4bc-94f8-4530-bd2f-cf7f73353b92 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:16.084776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf4bc-94f8-4530-bd2f-cf7f73353b92 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:16.086192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 78/162] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:16.087685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf4bc-94f8-4530-bd2f-cf7f73353b92 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:16.175297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:16.175922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:16.176853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:16.177193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:16.284105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:16.284294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:16.293788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07de2e-a1be-46a8-aa8e-41bca745f8c2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:16.302556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf4bc-94f8-4530-bd2f-cf7f73353b92 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:16.369815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:16.370464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:16.370742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:16.371016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:16.391598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:16.397136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:16.398116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:16.399640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 79/163] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:16.406517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:16.447208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:16.469409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 85/164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:16.472160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:16.472658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:16.473673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:16.516356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:16.517556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:16.716939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2059b5-b48c-4b9e-bd1a-adfd8de539c8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:16.784634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:16.786284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:16.786525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:16.786796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:16.788577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:16.790243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:16.795178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 86/165] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:16.796018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:16.801828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 80/166] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:16 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:16.803354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:16.852782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:16.981621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90411682-0cc3-4505-9f1a-6bec931a2fbb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.022970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.023659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.025437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.025740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.027747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:17.031034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e396e04-b2fb-4b66-a4e4-3748fb5766fc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:17.031034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 81/167] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:16 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:17.032281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714cd3-8011-4802-9085-35bffa59859d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.032281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714cd3-8011-4802-9085-35bffa59859d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.032541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714cd3-8011-4802-9085-35bffa59859d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.033966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 82/168] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:17.034908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714cd3-8011-4802-9085-35bffa59859d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.061766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bdbb-7137-4641-97ca-3b17c0856a95 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.109508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:17.137514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.137514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.137514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.137514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.137963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:17.137963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:17.137963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec1b16-1339-4a87-8d1d-1a68ed3baaa6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:17.153809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 87/169] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:17.154837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1982e3-f517-45d2-a734-87f547a8946b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.155120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1982e3-f517-45d2-a734-87f547a8946b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.169514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1982e3-f517-45d2-a734-87f547a8946b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.169688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 88/170] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:17 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:17.170874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7adbe-263d-49d5-9e2a-d41336bca126 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.171208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7adbe-263d-49d5-9e2a-d41336bca126 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.173794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7adbe-263d-49d5-9e2a-d41336bca126 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.180577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:17.180708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 89/171] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:17.181552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7adbe-263d-49d5-9e2a-d41336bca126 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.184694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714cd3-8011-4802-9085-35bffa59859d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.232959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.233446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.233763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.234031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.234763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:17.235062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:17.236508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337ae2b-469d-4c54-8bbd-0f66917b742c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:17.244224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 83/172] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:17.246067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa0c0-4d11-41cd-a820-fec744b8896d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.246475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa0c0-4d11-41cd-a820-fec744b8896d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.246751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa0c0-4d11-41cd-a820-fec744b8896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.283224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c6ffa0c0-4d11-41cd-a820-fec744b8896d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:17.285265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c6ffa0c0-4d11-41cd-a820-fec744b8896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:17.312312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7adbe-263d-49d5-9e2a-d41336bca126 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.352707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.353385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.353711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.353981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.354864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=fe6635e8dd81449693cd6bc25f154f24) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:17.355169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:17.356847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:17.364510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 90/173] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/role_assignments?user.id=fe6635e8dd81449693cd6bc25f154f24&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:17.365371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.388940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 84/174] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:17.390320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70c7e-1981-4c8a-ac13-7905c2aecc5b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.390600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70c7e-1981-4c8a-ac13-7905c2aecc5b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.390918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70c7e-1981-4c8a-ac13-7905c2aecc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.413592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2bf70c7e-1981-4c8a-ac13-7905c2aecc5b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:17.414808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2bf70c7e-1981-4c8a-ac13-7905c2aecc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:17.440093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:17.546190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 85/175] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:17.547380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.547657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.547926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.558856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ee1f-5d62-4387-a1ba-0be59b965934 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.578611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:17.579794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:17.603008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:17.623002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.623643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.623921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.624198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.625564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:17.626956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:17.628721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 91/176] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:17.631595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.718934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 86/177] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:17.719877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.825089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70113bf-aa84-48c2-add6-630039f092bf None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.847785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:17.877706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.878344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.878616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.878881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.890874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:17.896734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:17.898187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 92/178] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:17.899148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:17.901926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5fd0a-43bb-4620-bc8b-8fe6654a382f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:17.939917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:17.940694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:17.941068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:17.941440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:17.959712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.010457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4bb61-731b-4706-b90c-488673a715af None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.017540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.019300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.048672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.049360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.049733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.050028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.061835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-82aa9bea-83dc-4d2c-a108-7e167f56b1a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:18.067360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:18.068214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:18.068980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:18.070437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e7701-4125-41e8-b370-9b02cd2bd08a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.070437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e7701-4125-41e8-b370-9b02cd2bd08a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.070606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e7701-4125-41e8-b370-9b02cd2bd08a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.071959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 94/180] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:18.072521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e7701-4125-41e8-b370-9b02cd2bd08a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.112833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.136026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 87/181] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:18.140753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.182019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e7701-4125-41e8-b370-9b02cd2bd08a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.184924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.215592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.216192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.216465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.216736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.217397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:18.217726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.219093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.227517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 95/182] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.228373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.239298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa60dc-fe10-4789-86f3-1c8d840015ff None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.273503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.274132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.274406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.274686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.275794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.277242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebcd69-fdd7-4038-bfe5-cc6929a86d9b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.278823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 88/183] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.279907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.280184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.280459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.298814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:18.299998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:18.322545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.328708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8d7c-9a82-4785-8f9f-d2eb125f00bd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.364016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.364550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.364827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.365102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.365802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:18.366106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.367469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.369598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 89/184] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:18.370265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.376129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 96/185] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.376828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.431878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.486158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc955e3-cfc8-4f2b-a9e6-40931e3711f4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.490676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c61523-6f4c-4241-9258-2a957b288669 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.519593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.520875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.521174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.521453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] PATH_INFO: `/v3/projects/4ef5f9fb956f474da331eff8305f54f5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.522623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f9fb956f474da331eff8305f54f5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.524060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.525712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 97/186] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/projects/4ef5f9fb956f474da331eff8305f54f5 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.526465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.533615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.534258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.534566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.534843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.547312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:18.553392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:18.554490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 90/187] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:18.555375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.564391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.645777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bce27-7682-457f-b9bc-48ced6a2a82e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.670437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2706-c2a2-44f2-9d54-fa91931932ca None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.672769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.680259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.680890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.681166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.681433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] PATH_INFO: `/v3/users/74e95fb0b04948b3bae443ca4a948045` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.682584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] RBAC: Authorizing `identity:get_user(user_id=74e95fb0b04948b3bae443ca4a948045)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.684025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.690384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 98/188] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/users/74e95fb0b04948b3bae443ca4a948045 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.690384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.711483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.712089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.712361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.712626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.713275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.714738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.736616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 91/189] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:18 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:18.742964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.803951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:18.813227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c78b4-d830-49b1-9733-f762b9b7d355 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.853111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.853781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.854063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.854338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.870021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6027-fead-4db7-a8df-804f32405930 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:18.872056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.874216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.875932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 99/190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.876709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.915836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:18.916394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:18.916678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:18.916955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:18.917741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=4ef5f9fb956f474da331eff8305f54f5, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:18.918056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:18.919772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:18.933528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 92/191] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=4ef5f9fb956f474da331eff8305f54f5&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:18.933528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:18.964781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.003072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447225-4f29-4ca2-a3f1-1f0453d04a60 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.054926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.055547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.055824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.056089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.056768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:19.057055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.058518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.069367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:19.070104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.091326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4761-6da3-46d4-a579-f1c61d1c75ad None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.096266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.140913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.141580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.141862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.142135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.156484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:19.162105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:19.162987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:19.163766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 93/193] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:19.164428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.206450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949add40-84b7-47ff-962b-74f4ccc6c656 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.252199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.253759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.254040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.254473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.269326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.294604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45076cd0-3609-402a-95a2-025105074e7d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.337474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.338338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.339013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.339289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.350400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.352479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.373812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.427553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.429246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.497338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 101/194] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:19.498267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.527143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.547736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 94/195] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:19.553923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.613313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2631e4-dfdc-4f05-8b6e-6534902faee5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.631764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.654226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.655064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.655493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.655996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.657236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.658922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.660762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 102/196] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:19.661672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.682350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2f53f-7cd0-406b-a14c-50ef3867f9a7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.719997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.720795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.721210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.721601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.722341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:19.722712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.724377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.733599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 95/197] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:19.734574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.786618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.788214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490769-e1c9-4bfe-8d0a-4711660ff71a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.829170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.829970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.830249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.830520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.831919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.833956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.836179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 103/198] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:19.836955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.853947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660bb-923e-40b0-adf3-deb326b9947d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:19.894472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:19.898446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:19.899542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:19.899842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:19.900115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:19.901406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:19.903154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:19.905718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 96/199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:19.906488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:19.968992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a506d2-cd2b-47bb-be34-c0700c403046 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.016524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.017260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.017567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.017843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.026449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6898bd-4211-449b-bb61-322680232f64 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.041546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.066330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.068111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.068608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.069194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] PATH_INFO: `/v3/users/9e23e91975c24d989ffa838bd02cf5c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.070869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] RBAC: Authorizing `identity:get_user(user_id=9e23e91975c24d989ffa838bd02cf5c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.072632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.074640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 97/200] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/users/9e23e91975c24d989ffa838bd02cf5c1 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:20.075831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.114863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.116752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.180756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.193630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1093-10dd-41db-bc03-c9b221170e4c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.229646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.230676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.231165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.231735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.232780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=74e95fb0b04948b3bae443ca4a948045) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:20.233294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.235185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.245670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 104/202] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:20.245967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 98/202] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/role_assignments?user.id=74e95fb0b04948b3bae443ca4a948045&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:20.247065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.251128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.357876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.393909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989612d-1237-4640-bfc0-e6fa204ef6c8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.457757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.458512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.458903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.459427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.460705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=0b0953bbfece4a59b5196ccb45183590) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:20.461024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.462848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.470822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 105/203] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/role_assignments?user.id=0b0953bbfece4a59b5196ccb45183590&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:20.471653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.472611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847970a6-ca81-45d6-8230-5fe8b24d9496 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.503167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.540262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.542112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.542851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.544039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.640285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.642132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.662169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb32b14-e297-466f-bed7-2bed57a000c3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.708307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.715751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.716405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.716681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.716956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.721180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.724779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.726619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 106/204] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:20.732641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.819104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 99/205] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:20.827540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:20.837880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:20.859450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d318d-ab57-4b98-b1dd-ec4eaf65a94d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:20.898771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:20.899456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.899750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.900033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.900785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=0b0953bbfece4a59b5196ccb45183590) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:20.901102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:20.902730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d935-7d29-4b71-ac5d-0c6a6a654849 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:20.908814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 107/206] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/role_assignments?user.id=0b0953bbfece4a59b5196ccb45183590&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:20.976665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270391-0969-4172-a200-af7eaeb56b30 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.976952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270391-0969-4172-a200-af7eaeb56b30 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.977256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270391-0969-4172-a200-af7eaeb56b30 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:20.978701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 108/207] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:20.992217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf1bc-6743-4d4b-83b3-5234c12eb49b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:20.992495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf1bc-6743-4d4b-83b3-5234c12eb49b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:20.992771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf1bc-6743-4d4b-83b3-5234c12eb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.028571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1a9cf1bc-6743-4d4b-83b3-5234c12eb49b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:21.029856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1a9cf1bc-6743-4d4b-83b3-5234c12eb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:21.059672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d002d0-802f-4445-9106-a4a5ec491760 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.122283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.123375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.123883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.124355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.126113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:21.127892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b27ab7-fc66-41d1-b780-3b0630782ded None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:21.130830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 100/208] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:20 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:21.132520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96443-e35e-41fe-a136-88252215672b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.133025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96443-e35e-41fe-a136-88252215672b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.133537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96443-e35e-41fe-a136-88252215672b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.135283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 101/209] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:21.140166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b96443-e35e-41fe-a136-88252215672b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.141640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 109/210] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:21.143005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.143286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.143557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.157432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:21.178108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:21.179356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:21.261671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b96443-e35e-41fe-a136-88252215672b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.300645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.302482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.302996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.303481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.304424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, scope.project.id=044cc590d0254a40912537ba235d27da, user.id=9e23e91975c24d989ffa838bd02cf5c1) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:21.304926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:21.306662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:21.312768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 110/211] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:21.313626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 102/212] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:21 2022] GET /identity/v3/role_assignments?user.id=9e23e91975c24d989ffa838bd02cf5c1&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:21.505430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.514293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:21.608551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.613081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8e03-4d51-4b4d-bda4-8b09d046754d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.667450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.668439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.669035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.669796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.682960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:21.687889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:21.688753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:21.689580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 111/213] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:21.695876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.713579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:21.739284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549ec1-f9ae-4d35-b253-73a148cf332e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.766293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:21.788225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.789849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.790459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.790932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.792884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:21.794874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:21.797853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 103/214] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:21.804583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.815581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e2b-214b-467d-a151-5eec2e110dfd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.862179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.862808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.863086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.863357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.864618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:21.865010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:21.866991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:21.881613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 112/215] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:21.883020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:21.922728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2dd5-e93d-4f54-ad86-0c60c41cf1f9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:21.961634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:21.962594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:21.963075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:21.963563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:21.964428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:21.966317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:21.996398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 104/216] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:21 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:21.997770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f3ff2-09b8-47a9-86e7-56f6d970154e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:22.034756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:22.046537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:22.047640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:22.048149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:22.048751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] PATH_INFO: `/v3/users/e7abb739d3914e7bb45d93b4ef753de7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:22.065824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] RBAC: Authorizing `identity:get_user(user_id=e7abb739d3914e7bb45d93b4ef753de7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:22.067833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:22.070458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 113/217] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:21 2022] GET /identity/v3/users/e7abb739d3914e7bb45d93b4ef753de7 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:22.077897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:22.089656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:22.192640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57880bf-0328-45a9-ac59-bc61d8890b32 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:22.226885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:22.227500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:22.227778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:22.228045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:22.296921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:22.298357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:22.300143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:22.404290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 105/218] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:22.405684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:22.511047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47f0b9-a4b7-4c02-9f82-97760f14ed9a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:22.547974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:22.548520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:22.548794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:22.549063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:22.550223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:22.552261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a15882-db11-48d5-bc82-4b62eab24395 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:22.556496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 114/219] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:22 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:22.560425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:22.663791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f76add-1a10-4b24-814f-8d8c56ce5785 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:22.665346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:22.700660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:22.701269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:22.701569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:22.701840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:22.702571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=e7abb739d3914e7bb45d93b4ef753de7) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:22.702876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:22.704302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d28ea-9597-46eb-a54d-aa5aceb818ad None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:22.717594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 106/220] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:22 2022] GET /identity/v3/role_assignments?user.id=e7abb739d3914e7bb45d93b4ef753de7&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:23.009810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fce99-8edb-4b6b-9516-9fd27eb88477 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.010182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fce99-8edb-4b6b-9516-9fd27eb88477 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.010359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fce99-8edb-4b6b-9516-9fd27eb88477 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.011980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 115/221] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:23.017107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a139d-545b-4518-9dd7-bf35803fc2dc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.017588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a139d-545b-4518-9dd7-bf35803fc2dc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.017661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a139d-545b-4518-9dd7-bf35803fc2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.036889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6d3a139d-545b-4518-9dd7-bf35803fc2dc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:23.042165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6d3a139d-545b-4518-9dd7-bf35803fc2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:23.132212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 107/222] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:23.210604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e1dd-e9b8-4c46-808f-20adc53a0bb3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.211226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e1dd-e9b8-4c46-808f-20adc53a0bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.211705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e1dd-e9b8-4c46-808f-20adc53a0bb3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.213290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 116/223] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:23.218622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.218908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.219183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.242481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:23.243673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:23.317572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 108/224] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:23.465023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e1dd-e9b8-4c46-808f-20adc53a0bb3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:23.530638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:23.595123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e1dd-e9b8-4c46-808f-20adc53a0bb3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:23.640937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:23.641600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.641884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.642162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.653638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:23.662393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:23.663303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:23.664104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 117/225] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:23.671244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:23.691222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:23.721426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:23.863172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12309fe-47ff-40ee-9f01-3bcfcc9409d1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:23.891150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52d04-49b4-4b7a-aca9-27281e4d7226 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:23.907397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:23.916763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:23.917376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.917677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.917944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.918607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:23.918903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:23.920527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:23.928798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 109/226] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:23.933798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:23.953337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:23.954010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:23.954291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:23.954566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:23.978745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:23.983972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:23.984821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:23.985605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 118/227] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:23.993865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.033992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:24.051552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80543bd-a0f2-4f65-ace3-dfa73b16ceab None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.116355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.116923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.117191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.117457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.118720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.120158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.123930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 110/228] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:23 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:24.128341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.201888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33c93-e98a-4695-8f73-30f749926edc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.267551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.268536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.269006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.269507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.270574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:24.271064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.272635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.291157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 119/229] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:24.297308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.320912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7dd3-a18e-40e2-b001-53fe7eaad435 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.369957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:24.386349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.387319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.387888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.388348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.389761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.391403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.393646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 111/230] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:24 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:24.403595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.445858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:24.514817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf466-a108-4794-bb77-a4c24df81f05 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.561226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cab282-ce01-40b3-a0ae-da27838d4bbe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.580704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.581375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.581650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.581925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.584463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.585956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.587581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 120/231] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:24 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:24.592998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.630243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.631491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.631772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.632045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/users/0b0953bbfece4a59b5196ccb45183590/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.635399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, user_id=0b0953bbfece4a59b5196ccb45183590, role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.636890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaabd68-580b-4c59-881e-0ba714388ff2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.676616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 112/232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:24 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/users/0b0953bbfece4a59b5196ccb45183590/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:24.742387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f93c-47ba-49b4-8ab3-aee3b23170fd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.742387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f93c-47ba-49b4-8ab3-aee3b23170fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.742387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f93c-47ba-49b4-8ab3-aee3b23170fd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.744846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 113/233] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:24.748331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4155-9bdd-4ee7-bc33-4a1496c9dc77 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.748331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4155-9bdd-4ee7-bc33-4a1496c9dc77 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.748331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4155-9bdd-4ee7-bc33-4a1496c9dc77 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.749164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 114/234] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:24.752233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.752778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.753262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.756055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa416589-775e-4294-a80d-d2e4a7d1709b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:24.759394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:24.778677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:24.780416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:24.797093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:24.797906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.798195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.798474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.799820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:24.801943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d44d7-5098-4703-8a13-9587ee7b9ef5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:24.804289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 121/235] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:24 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:24.805716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51645-f507-4c6c-8d2c-e33622bedef1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.806002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51645-f507-4c6c-8d2c-e33622bedef1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.806279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51645-f507-4c6c-8d2c-e33622bedef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.830322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d9d51645-f507-4c6c-8d2c-e33622bedef1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:24.831552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d9d51645-f507-4c6c-8d2c-e33622bedef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:24.869638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:24.871004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:24.900637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:24.931126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 122/237] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:24.932686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cbd12-b1f3-4cf1-9501-4e3f69bf512d None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.932978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cbd12-b1f3-4cf1-9501-4e3f69bf512d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.933251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cbd12-b1f3-4cf1-9501-4e3f69bf512d None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.935618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 123/238] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:24.941070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:24.941597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:24.941896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:24.961069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:24.962354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:25.022148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ae33-18db-4ac3-a9e8-8893aa8b3b03 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.045289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 124/239] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:25.077666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.078435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.078725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.078939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/users/0b0953bbfece4a59b5196ccb45183590/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.080960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, user_id=0b0953bbfece4a59b5196ccb45183590, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:25.082624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:25.118029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 116/240] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:24 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/users/0b0953bbfece4a59b5196ccb45183590/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:25.235017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.269315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:25.347316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.368656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188f0e-786a-4182-80b4-0cafd98cdbb0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.411110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.411750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.412025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.412298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.413413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:25.414986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:25.416725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 125/241] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:25.417307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.455553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:25.494897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605f68-df22-4043-8eb6-711eda6e7ce5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.535924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:25.539405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a8c1-abfd-4edf-982e-cd1f843aa1ab None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.546081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.546987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.547466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.547960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.562505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:25.570427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:25.571313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:25.572067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 117/242] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:25.572699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.585784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.586443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.586688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.586958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.597742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:25.603299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:25.604153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:25.604925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:25.609163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 126/243] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:25.610026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.712343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b83f-8ee0-421a-b4bd-7398bfa49298 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.734383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96fdef-28c0-47ff-abbd-41197ec5e221 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:25.757894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.758583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.758952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.759411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.760099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:25.761812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:25.770233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:25.783031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:25.783632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:25.783909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:25.784176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:25.784873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:25.785206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:25.786667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:25.792088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 118/244] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:25 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:25.792733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.800266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 127/245] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:25.807326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:25.883405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:25.931948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf48d2-425a-45db-81f8-b51cc6a59356 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.005021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa912-4b88-4cd5-8cb3-d584448497e7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.011426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.012096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.012481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.012862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.013706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:26.014115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.015916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.026531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 119/246] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:26.032613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.050320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.052585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.053055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.053646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] PATH_INFO: `/v3/users/1502465bb79e4ec0b54fc1ffde641f8c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.074387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] RBAC: Authorizing `identity:get_user(user_id=1502465bb79e4ec0b54fc1ffde641f8c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.075887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.077955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 128/247] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:25 2022] GET /identity/v3/users/1502465bb79e4ec0b54fc1ffde641f8c => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:26.088855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.130021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:26.186760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598921d8-f6f4-40e1-896e-9168e4d89d48 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.193688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:26.216465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd280fa-aea8-410a-82fc-42344f779b73 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.223450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.224493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.224980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.225437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] PATH_INFO: `/v3/users/e7abb739d3914e7bb45d93b4ef753de7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.226792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] RBAC: Authorizing `identity:get_user(user_id=e7abb739d3914e7bb45d93b4ef753de7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.228467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.230309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 120/248] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:26 2022] GET /identity/v3/users/e7abb739d3914e7bb45d93b4ef753de7 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:26.236590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.256067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.256743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.257023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.257324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.335201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.336840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.355527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68ce9-ac9e-4ad3-b254-5c8e6278635e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.383057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:26.403592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.404930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.405352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.405910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.407464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.409407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.412428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 121/249] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:26 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:26.418735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.459910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:26.493763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 129/250] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:26.499552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.558630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420bb65-9000-4864-aad6-75e8794ff83c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.609657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e6f21-4e9b-4cb2-b26a-d640dac5eead None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.618472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.619145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.619466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.619694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/users/e7abb739d3914e7bb45d93b4ef753de7/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.626509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, user_id=e7abb739d3914e7bb45d93b4ef753de7, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.628089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a29e-6399-4049-ac70-8ec33697d291 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.648006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.648748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.649060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.649405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.650593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.652057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.653745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 130/251] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:26 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:26.656911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 122/252] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:26 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/users/e7abb739d3914e7bb45d93b4ef753de7/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:26.659627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:26.717550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:26.774300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d229e-dbbf-48b1-9f0d-6fa49961468a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:26.812344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:26.812970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:26.813252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:26.813553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:26.814314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=1502465bb79e4ec0b54fc1ffde641f8c) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:26.814627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:26.816186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f45d0-a022-49ef-a5f7-7f3bfbea0fb6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:26.823502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 131/253] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:26 2022] GET /identity/v3/role_assignments?user.id=1502465bb79e4ec0b54fc1ffde641f8c&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:27.157339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128a08-609f-4390-9eab-a9e1cf2a0658 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:27.157879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128a08-609f-4390-9eab-a9e1cf2a0658 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:27.157879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36128a08-609f-4390-9eab-a9e1cf2a0658 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:27.159234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 123/254] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:27.164456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:27.164741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:27.165016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:27.192388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:27.193600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:27.273925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 132/255] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:27.819404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36128a08-609f-4390-9eab-a9e1cf2a0658 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:27.876995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:27.942384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36128a08-609f-4390-9eab-a9e1cf2a0658 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:27.981360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:27.982010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:27.982285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:27.982554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:27.992636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-aa96de3b-159b-4662-bdca-e31688a91c69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:27.999151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:28.000026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:28.000793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 124/256] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:28.007907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:28.036347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d25a7-5495-4c91-9a65-f4da99f752c7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.037137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d25a7-5495-4c91-9a65-f4da99f752c7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.037650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d25a7-5495-4c91-9a65-f4da99f752c7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.039210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 125/257] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:28.045800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.046519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.047017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.069580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:28.071242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:28.096768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:28.171190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 126/258] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:28.226056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f561f9-43bd-49dd-8eea-c8f2cce3f9a9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:28.286286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:28.286901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.287177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.287446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.288177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:28.288478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:28.289937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:28.301524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 133/259] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:28.307033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:28.381072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:28.479887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bffd9-246b-4bf6-b610-3435124bb78f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:28.526895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:28.527540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.527819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.528093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.534149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:28.536603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:28.538236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 127/260] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:28 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:28.543965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:28.665537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:28.673819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0361-aa24-4988-96c5-76c4ab7a73b2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:28.676897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:28.710675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:28.711270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.711543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.711822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.825552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:28.827301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a699a1e-9ff0-493a-927b-87ae072496bd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:28.908286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a25ee-2820-4834-a1db-4e48d1eaa809 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:28.926589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:28.929776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 134/261] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:28.931262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763c20-2026-4975-8006-d564fe48bde8 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.931548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763c20-2026-4975-8006-d564fe48bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.931823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763c20-2026-4975-8006-d564fe48bde8 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:28.933256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 135/262] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:28.938332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05763c20-2026-4975-8006-d564fe48bde8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:28.942738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:28.986213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:28.987039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:28.987321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:28.987594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.006577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e73345dc-0f1e-4bf5-92bd-2e539ccfd41a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:29.019704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:29.020576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:29.021331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 128/263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:29.022485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.022656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.022902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.060441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:29.061650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:29.067071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05763c20-2026-4975-8006-d564fe48bde8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.136550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.137186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.137455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.137751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.145613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:29.147087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:29.151809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 136/264] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:28 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:29.152630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.209677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 129/265] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:29.210524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.290017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:29.315178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126c95-f2d3-495d-8f25-b33d8a1a1ee9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.368901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.369789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.370233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.370685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.371482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:29.371908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:29.373395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc4381-37c0-4c13-9e2e-7c24896fdec7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:29.383230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 137/266] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:29.384820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba5d7-2456-4643-b64e-ea389471ee84 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.385314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba5d7-2456-4643-b64e-ea389471ee84 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.385817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba5d7-2456-4643-b64e-ea389471ee84 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.387279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 138/267] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:29.389282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba5d7-2456-4643-b64e-ea389471ee84 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.393882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:29.406877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7614d2f-c750-4ccf-9d34-016ebcb854da None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.469248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.470216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.470786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.471267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.472203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=0b0953bbfece4a59b5196ccb45183590) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:29.473255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:29.475105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b15f-9914-4f85-94ea-87ecfaa3e3a4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:29.490306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 130/268] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/role_assignments?user.id=0b0953bbfece4a59b5196ccb45183590&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:29.494877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.496337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.496984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.537042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:29.538851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:29.578791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba5d7-2456-4643-b64e-ea389471ee84 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.634142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.634798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.635078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.635352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] PATH_INFO: `/v3/users/0b0953bbfece4a59b5196ccb45183590` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0953bbfece4a59b5196ccb45183590)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:29.638602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a578f-3eac-4805-9349-0ffc40937e63 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:29.639349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 131/269] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:29.640488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.640614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 139/270] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/users/0b0953bbfece4a59b5196ccb45183590 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:29.641905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67d97-b140-491a-9116-ad6948c7420c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.642188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67d97-b140-491a-9116-ad6948c7420c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.642466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67d97-b140-491a-9116-ad6948c7420c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.644032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 140/271] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:29.646778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67d97-b140-491a-9116-ad6948c7420c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.649804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:29.756886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:29.770375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418ee6-a277-47a2-82e6-8a7bb5aa220c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.815809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.817160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.817511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.817922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.829521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:29.831764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67d97-b140-491a-9116-ad6948c7420c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-c6747d6c-9135-4864-9a53-51ff7743800f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:29.835504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:29.836399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:29.837173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 132/272] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:29.845228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a77b5-574a-4cfd-a5e8-797beb864dde None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.845228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a77b5-574a-4cfd-a5e8-797beb864dde None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.845228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a77b5-574a-4cfd-a5e8-797beb864dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.859605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-853a77b5-574a-4cfd-a5e8-797beb864dde None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:29.860800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-853a77b5-574a-4cfd-a5e8-797beb864dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:29.882035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:29.883056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.883269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.883545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.939625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 133/273] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:29.941787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709a72-0985-4cc1-b9ad-36db9e9483ff None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:29.942426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709a72-0985-4cc1-b9ad-36db9e9483ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:29.942426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709a72-0985-4cc1-b9ad-36db9e9483ff None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:29.943710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 134/274] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:29.944401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d709a72-0985-4cc1-b9ad-36db9e9483ff None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:29.971928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:29.973437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:29.975313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.043116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.067647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d709a72-0985-4cc1-b9ad-36db9e9483ff None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.083993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 141/275] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:30.084720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.115720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.116413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.116763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.117182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.117748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:30.118054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.119427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbd2a4-82d6-4a76-a1a3-0ca7192640b2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.128233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 135/276] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.130865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.131215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.131561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.149707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:30.150897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:30.198665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912701f-1136-47d6-b246-d6885264d55c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.200995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.222185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 136/277] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:30.223748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.246041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.246750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.246942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.247217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.258530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:30.263365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:30.264212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:30.264985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:30.265656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.300182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.334926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a62cc-caae-44da-bfa0-0274423c271b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.370480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.371329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.371618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.371886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.373008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.374474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.376268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 137/279] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.378327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.378642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402b41-c71b-42b8-9f7f-59bb023b16ea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.414427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.415064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.415325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.415601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] PATH_INFO: `/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.431352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] RBAC: Authorizing `identity:get_user(user_id=ab2f2dcb65344c3e9af1be7f12d36b79)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.432812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.434462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 143/280] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.435222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.460120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.495394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c57bd-d992-454b-a55a-b1614b56d1c1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.530626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.531259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.531540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.531815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.532923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.534490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.536112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 138/281] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.537787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.542765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d039-e6bf-4424-8307-c50de778c84e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.547882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.577236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.577797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.578084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.578359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.579023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:30.579326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.580774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.589277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 144/282] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.590089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.637218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e28204-0bdc-4fe8-85db-251924602e70 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.669753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.670290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.670906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.671180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.671545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.672316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=0b0953bbfece4a59b5196ccb45183590) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:30.672622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.674101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.679950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 139/283] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/role_assignments?user.id=0b0953bbfece4a59b5196ccb45183590&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.680879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.703053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806c55-3b9a-45d1-8d79-93dda90ff5f3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.755944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.756662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.757168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.757455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.758282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, user.id=ab2f2dcb65344c3e9af1be7f12d36b79, scope.system=all) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:30.758571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.760059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:30.764388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:30.777697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 145/284] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/role_assignments?user.id=ab2f2dcb65344c3e9af1be7f12d36b79&scope.system=all&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:30.777697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.810392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a5e6b-ed42-4f67-9f58-10a287d031b1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.868339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.868993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.869279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.869588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.884749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:30.891294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:30.892232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:30.893003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 140/285] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:30.893684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:30.934678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe58a-7213-4c06-8756-9395f93d8364 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:30.981470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:30.982112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:30.982430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:30.982793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:30.983456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:30.984911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.009892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 146/286] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:30 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:31.010795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.021160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.034410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04eca-b0df-43ef-b8ef-73e3c80b72ab None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.075265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.083113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.084220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.084868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.085356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] PATH_INFO: `/v3/users/e7abb739d3914e7bb45d93b4ef753de7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.087157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] RBAC: Authorizing `identity:get_user(user_id=e7abb739d3914e7bb45d93b4ef753de7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.089034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.091190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 141/287] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:30 2022] GET /identity/v3/users/e7abb739d3914e7bb45d93b4ef753de7 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:31.098134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.173804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01583d-4bc9-4695-b9bd-4f7f6261f9a2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.217163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.217812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.218094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.218374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.219049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:31.219403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.221239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.231762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 147/288] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:31.237323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.247149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b8a5-458d-4b10-ad86-e342e7b3fea4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.302979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.303934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.304210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.304807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.329148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.385420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c46d87-4ffb-43c0-b820-183a209b156c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.390299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.393949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.396463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.430551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.431112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.431390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.431663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] PATH_INFO: `/v3/users/1502465bb79e4ec0b54fc1ffde641f8c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.432800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] RBAC: Authorizing `identity:get_user(user_id=1502465bb79e4ec0b54fc1ffde641f8c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.434518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.436171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 148/289] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/users/1502465bb79e4ec0b54fc1ffde641f8c => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:31.443581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.534735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 142/290] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:31.540956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.573665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae01b0-4862-4ca4-8532-7f9bab86f2dd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.612575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.621264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.622960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.625081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.625875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.628281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.631500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.634913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 149/291] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:31.641599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.706331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:31.714293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a653f5-e8c5-4d09-870f-917e6a2d1d0f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.779191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.779834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.780109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.780377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.786203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.787673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.789524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 143/292] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:31.795231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:31.809407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b35e7-454e-43e1-8100-549a9221aa35 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:31.853505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:31.854499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:31.854925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:31.855342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/users/1502465bb79e4ec0b54fc1ffde641f8c/roles/38e85fc2129244bfab565b6aa7ed9acf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:31.860891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, user_id=1502465bb79e4ec0b54fc1ffde641f8c, role_id=38e85fc2129244bfab565b6aa7ed9acf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:31.865413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8166e3a-06ff-4ad3-8ebf-b224cd3508c0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:31.905846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 150/293] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:46:31 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/users/1502465bb79e4ec0b54fc1ffde641f8c/roles/38e85fc2129244bfab565b6aa7ed9acf => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:46:31.943594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2cf8c-f35e-4c6d-902a-dd0f565c503b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:32.001257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:32.001867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:32.002144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:32.002411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:32.003151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=e7abb739d3914e7bb45d93b4ef753de7) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:32.003450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:32.005599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917308-e69d-469c-9949-7b65fe9317c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:32.012244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 144/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:31 2022] GET /identity/v3/role_assignments?user.id=e7abb739d3914e7bb45d93b4ef753de7&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:32.856502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daeed5-28a0-40bc-9b7e-4114233727a5 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:32.857021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daeed5-28a0-40bc-9b7e-4114233727a5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:32.857021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daeed5-28a0-40bc-9b7e-4114233727a5 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:32.858685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 151/295] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:32.864716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:32.865110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:32.865274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:32.884135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:32.885314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:32.912200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:32.955551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 145/296] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:33.234409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daeed5-28a0-40bc-9b7e-4114233727a5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:33.302506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:33.350556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daeed5-28a0-40bc-9b7e-4114233727a5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:33.385267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:33.385928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.386208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.386479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.397271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5d349c70-ec8f-4616-98fc-1cb9be8c01bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:33.402784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:33.403637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:33.404436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 152/297] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:33.410560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:33.422080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f8b-a836-4aa0-bafa-8288088982f3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.422364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f8b-a836-4aa0-bafa-8288088982f3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.422625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f8b-a836-4aa0-bafa-8288088982f3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.424209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 153/298] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:33.429937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a5-8c3a-470b-b227-ac3733c267af None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.430215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a5-8c3a-470b-b227-ac3733c267af None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.430483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a5-8c3a-470b-b227-ac3733c267af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.448885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ae0528a5-8c3a-470b-b227-ac3733c267af None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:33.450103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ae0528a5-8c3a-470b-b227-ac3733c267af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:33.531750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f6eb-d156-4e7f-9162-c30dd426e56a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:33.534054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 154/299] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:33.557823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbd23-eda7-4886-92e9-a6e066e77142 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.558116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbd23-eda7-4886-92e9-a6e066e77142 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.558399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbd23-eda7-4886-92e9-a6e066e77142 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.559994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 155/300] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:33.564737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.565024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.565304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.581731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:33.582938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.583305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.583645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.584427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:33.585037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:33.586269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:33.588161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:33.591583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:33.602075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 146/301] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:33.607400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:33.644900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:33.653827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:33.685509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 156/302] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:33.736169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1c91-d2ff-4367-93fb-50ff1c8af0e4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:33.771552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:33.772186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.772466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.772742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] PATH_INFO: `/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.773911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2f2dcb65344c3e9af1be7f12d36b79)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:33.775471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:33.777409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 147/303] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:33 2022] GET /identity/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:33.784066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:33.823256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:33.899369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496dff0-e2d3-4538-8a7d-9b2829294796 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:33.934881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:33.938491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:33.939370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.940003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.940440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] PATH_INFO: `/v3/system/users/ab2f2dcb65344c3e9af1be7f12d36b79/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:33.943372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ab2f2dcb65344c3e9af1be7f12d36b79, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:33.944891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:33.945044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5192f-2e73-4f6f-bcee-267e02acdb76 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:33.958671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 157/304] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 31 12:46:33 2022] PUT /identity/v3/system/users/ab2f2dcb65344c3e9af1be7f12d36b79/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:33.994948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:33.995668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:33.996007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:33.996283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.005870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.009664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:34.015729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:34.016745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:34.022898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 148/305] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:34.025416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.077535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:34.151516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037754c9-8077-4e7e-a880-f3e92d77ab36 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.154730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd30b8e-8cbb-4209-a1e6-62d9aff5a70d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.188489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.188725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.189138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.189413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.189717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.189959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.190385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.190806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.190915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.192280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:34.192726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.192848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd5ea-c05d-44b3-9e68-513d9f425dea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.194334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 158/306] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:34.194612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eead9e-9b90-43df-9c66-42b74e35755e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.199838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8314-1929-400e-b316-816114241b1e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.200119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8314-1929-400e-b316-816114241b1e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.200689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8314-1929-400e-b316-816114241b1e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.201972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 159/307] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:34.202643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8314-1929-400e-b316-816114241b1e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.208051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 149/308] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:34.209526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.209976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.210433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.231882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:34.233370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:34.244686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:34.309837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 150/309] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:34.310582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.323795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8314-1929-400e-b316-816114241b1e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.343193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:34.373257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.374214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.374502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.374781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] PATH_INFO: `/v3/groups` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.375414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.376849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.399162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 160/310] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 31 12:46:34 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:34.434252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6751-0948-4109-98fb-2485c2221992 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.477065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.478200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.478738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.479265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] PATH_INFO: `/v3/users/3403f14d77ff49db8dffe8d4fd759cbe` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.500718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] RBAC: Authorizing `identity:get_user(user_id=3403f14d77ff49db8dffe8d4fd759cbe)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.502244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.505183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 151/311] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/users/3403f14d77ff49db8dffe8d4fd759cbe => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:34.510873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.589748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.592833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:34.626989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc10bfe-5c2a-4c25-b1b6-933604a38b8f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.678662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.679340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.679627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.679905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.680655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, user.id=3403f14d77ff49db8dffe8d4fd759cbe, scope.system=all) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:34.680967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.682988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.690754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 161/312] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/role_assignments?user.id=3403f14d77ff49db8dffe8d4fd759cbe&scope.system=all&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:34.720357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb10f-d928-4ad7-98c9-ca10c6443721 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.762915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.763570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.763852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.764127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.777026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:34.782302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:34.783195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:34.784418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 152/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:34.790361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:34.833049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:34.905169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22fe24-bc8c-42fb-9a42-ce97104cb30c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:34.945381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:34.946028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:34.946310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:34.946583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:34.947318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:34.947622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:34.949047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:34.958281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 162/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:34.963964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:35.033359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:35.077142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628b4e-c2f6-445e-9250-5af4eb7fea12 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:35.117184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:35.117917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.118195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.118520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] PATH_INFO: `/v3/users/1502465bb79e4ec0b54fc1ffde641f8c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.119669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1502465bb79e4ec0b54fc1ffde641f8c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:35.121266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:35.123208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 153/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:34 2022] GET /identity/v3/users/1502465bb79e4ec0b54fc1ffde641f8c => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:35.130023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:35.234264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:35.238482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a2d5-47ae-4f62-a3ff-e159cd041bbc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:35.273503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:35.274113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.274388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.274656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.343115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:35.344649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:35.440162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:35.445209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 163/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:35.451669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:35.564419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5499b-7eb0-4c11-9b13-5f90c860c3e5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:35.594922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:35.602368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:35.603013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.603292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.603562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.604736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:35.606213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597e8b-4031-4d80-9764-1cb7dcfd14ca None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:35.608163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 154/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:35 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:35.614159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:35.720520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038480d-fb41-4562-ad49-2cec13c5f9d9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:35.757333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:35.758294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.758760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.759233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.760162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, scope.project.id=65589cf1224e45639928ed2020018be6, user.id=1502465bb79e4ec0b54fc1ffde641f8c) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:35.760658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:35.762407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05484-17f5-4ca0-ad77-09c662257ad3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:35.773599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 164/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:46:35 2022] GET /identity/v3/role_assignments?user.id=1502465bb79e4ec0b54fc1ffde641f8c&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:35.960706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb82-a562-4dfd-a407-d68e6aeb7f3c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.961000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb82-a562-4dfd-a407-d68e6aeb7f3c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.961242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454adb82-a562-4dfd-a407-d68e6aeb7f3c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.962916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 155/319] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:35.968681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fa1f-c38c-4e60-ad83-7aa5b391112a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:35.969113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fa1f-c38c-4e60-ad83-7aa5b391112a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:35.969299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fa1f-c38c-4e60-ad83-7aa5b391112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:35.987582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4f32fa1f-c38c-4e60-ad83-7aa5b391112a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:35.989497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4f32fa1f-c38c-4e60-ad83-7aa5b391112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:36.047861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:36.060245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 165/320] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:36.334901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454adb82-a562-4dfd-a407-d68e6aeb7f3c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:36.438811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454adb82-a562-4dfd-a407-d68e6aeb7f3c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:36.471560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:36.472685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.472970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.473233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.479417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475ff4-44ab-4eaf-ad3b-d966c9f4465e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.479711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475ff4-44ab-4eaf-ad3b-d966c9f4465e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.479992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475ff4-44ab-4eaf-ad3b-d966c9f4465e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.481475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 166/321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:36.484650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:36.486148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.486455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.486713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:36.490249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:36.491192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:36.491980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 156/322] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:36.496774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:36.509540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:36.510935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:36.561671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:36.583312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 167/323] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:36.605858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2734-7c4d-49b2-9011-6047981491dc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:36.640479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:36.641083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.641359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.641657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.642332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:36.642630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:36.643992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73da94c-a0f2-4490-8a95-d26444b8ff21 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:36.653093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 157/324] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:36.658402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:36.676369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865220f-8dc9-4397-a0d8-dfc6cc6c3955 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.676655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865220f-8dc9-4397-a0d8-dfc6cc6c3955 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.676931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865220f-8dc9-4397-a0d8-dfc6cc6c3955 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.678423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 158/325] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:36.683008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.683292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.683565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.704650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:36.706089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:36.765269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a138-ffe3-4fc9-87a9-b6b97b88da48 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:36.777389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 159/326] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:36.794336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:36.808227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:36.808941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.809314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.809688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] PATH_INFO: `/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.810882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2f2dcb65344c3e9af1be7f12d36b79)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:36.812384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:36.814227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 168/327] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:36 2022] GET /identity/v3/users/ab2f2dcb65344c3e9af1be7f12d36b79 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:36.820079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:36.851159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:36.874123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:36.930562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e5b7f-bc53-4e1b-a959-2d806e85b671 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:36.956523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f516-0cbf-4d86-b53e-c441eb33e942 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:36.965840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:36.966448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:36.966722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:36.966990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:36.967718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] RBAC: Adding query filter params (role.id=770fbbc02ae64fba9fac93fc4d59328a, user.id=ab2f2dcb65344c3e9af1be7f12d36b79, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:36.968020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:36.969438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:36.981445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 160/328] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 12:46:36 2022] GET /identity/v3/role_assignments?user.id=ab2f2dcb65344c3e9af1be7f12d36b79&scope.system=all&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:37.009206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.009983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.010339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.010682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.011945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:37.013496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:37.015517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 169/329] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:37.020984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:37.054112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:37.125597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:37.143950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cbe54-3923-481a-bd64-97acf6956e4b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:37.153522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:37.179017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffefbb2-fcbd-4c68-b2b9-a54b8cfbf4de None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:37.184029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.184723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.185053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.185333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] PATH_INFO: `/v3/groups` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.186064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:37.187509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:37.206383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 161/330] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 31 12:46:37 2022] POST /identity/v3/groups => generated 226 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:37.215469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.216115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.216388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.216655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.228965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:37.234081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:37.235198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:37.236020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 170/331] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:37.241682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:37.348702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e1c31-2cac-4816-b7bd-8b54ffaa7961 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:37.383908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.384472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.384751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.385027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.385719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:37.386023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:37.387432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:37.396283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 162/332] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:37.401958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:37.512085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7b185-8325-41d1-8558-6461edcdba62 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:37.531633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:37.553459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.554133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.554400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.554671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] PATH_INFO: `/v3/users/3403f14d77ff49db8dffe8d4fd759cbe` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.555881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] RBAC: Authorizing `identity:get_user(user_id=3403f14d77ff49db8dffe8d4fd759cbe)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:37.557521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80879e5-5d58-48f0-9777-c1991c3bdab3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:37.559520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 171/333] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:37 2022] GET /identity/v3/users/3403f14d77ff49db8dffe8d4fd759cbe => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:37.565226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:37.599935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:37.677924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ead2-88b9-4c94-8244-686ba684390b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:37.713567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:37.714232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:37.714510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:37.714791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] PATH_INFO: `/v3/system/users/3403f14d77ff49db8dffe8d4fd759cbe/roles/38e85fc2129244bfab565b6aa7ed9acf` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:37.716408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3403f14d77ff49db8dffe8d4fd759cbe, role_id=38e85fc2129244bfab565b6aa7ed9acf)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:37.717832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e5827-7e9e-4d5a-931e-b114b00198b4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:37.728514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 163/334] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 31 12:46:37 2022] PUT /identity/v3/system/users/3403f14d77ff49db8dffe8d4fd759cbe/roles/38e85fc2129244bfab565b6aa7ed9acf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:39.533768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3147-762c-4369-a380-d355830e4d7e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.534251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3147-762c-4369-a380-d355830e4d7e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.534251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3147-762c-4369-a380-d355830e4d7e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.535596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 172/335] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:39.541079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd84d-8fe0-423b-87d8-10354fd704e8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.541510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd84d-8fe0-423b-87d8-10354fd704e8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.541719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd84d-8fe0-423b-87d8-10354fd704e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.564006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ca3cd84d-8fe0-423b-87d8-10354fd704e8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:39.565185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ca3cd84d-8fe0-423b-87d8-10354fd704e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:39.642722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 164/336] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:39.807997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-e0ff-4e6a-b16e-94149458cf8a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.808288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-e0ff-4e6a-b16e-94149458cf8a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.808453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360926f7-e0ff-4e6a-b16e-94149458cf8a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.809827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 173/337] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:39.815186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.815746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.816298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.834994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccddc-830b-4387-9dc3-207b627b6c1c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.835621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccddc-830b-4387-9dc3-207b627b6c1c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.836118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccddc-830b-4387-9dc3-207b627b6c1c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.837682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 174/338] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:39.843288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:39.843876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:39.844339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:39.850493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:39.851695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:39.872776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:39.874475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:39.875670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:39.947122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 165/339] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:39.995124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 175/340] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:40.215775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.347463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b5ec2-8a1d-4efb-aaef-583e86acd988 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:40.365384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.416105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:40.416757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.417039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.417312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.442583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:40.447514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:40.448562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:40.449547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:40.458062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 166/341] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:40.459087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.485053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:40.519854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1536c85-5eec-4b64-a730-07f3b9d7da49 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:40.546350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:40.569909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:40.572995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.573533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.573998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.595573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:40.601614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:40.602470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:40.603235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:40.610492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 176/342] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:40.612365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.639588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862b0b-c2cd-40d4-8c7b-471d3782249b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:40.682777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:40.683770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.684290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.684758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.696586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-827007e2-8745-4ca3-accb-d5b49e0b8e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:40.702223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:40.703123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:40.703927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:40.706582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 167/343] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:40.708038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038400-3792-4a47-b198-f88285599497 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.708483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038400-3792-4a47-b198-f88285599497 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.708912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038400-3792-4a47-b198-f88285599497 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.711597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 168/344] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:40.712617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038400-3792-4a47-b198-f88285599497 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.767351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889204-168f-475d-86a6-4fcad845dc91 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:40.799322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:40.809912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:40.810524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.810795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.811062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.811832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:40.812133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:40.813630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854c382-f164-48e0-b29d-dd2c4f54bb6f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:40.823958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 177/345] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:40.825345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.825763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.826039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.829412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038400-3792-4a47-b198-f88285599497 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:40.849015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:40.850222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:40.867439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:40.868054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:40.868334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:40.868607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:40.869281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:40.869614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:40.871000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:40.881283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 169/346] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:40.882244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:40.888770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:40.959774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 178/347] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:40.960561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.016998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb796-f10d-4f67-a225-2c510f386ca5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.063309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.064316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.064837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.065310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.067491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:41.068052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:41.069958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:41.075323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.097025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 170/348] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:41.098091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.169658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215261-0267-4729-b8e3-54120a8e1b52 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.209675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.210742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.211223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.211877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.243353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebf93-4030-4326-b0d2-7d24e4c4fb4f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.252946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.279793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.280404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.280683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.281037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.294820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:41.296699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:41.360633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.369505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:41.372102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c9548-f8af-465a-89bc-df09b0daba67 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:41.427329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 179/349] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:41.428080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.510257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.511628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 171/350] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:41.512751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125227-7147-46ff-9d54-25605bfe23d3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.513925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125227-7147-46ff-9d54-25605bfe23d3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.514237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125227-7147-46ff-9d54-25605bfe23d3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.515763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 172/351] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:41.516487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125227-7147-46ff-9d54-25605bfe23d3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.568943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951beb8-2c7e-438b-8372-39897bd8005e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.610681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.611385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.611660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.611929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.647460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.652360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125227-7147-46ff-9d54-25605bfe23d3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.699723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.700655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.700946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.701221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.709638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:41.711093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:41.718641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:41.724052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:41.724961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:41.725757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 173/352] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:41.726417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.802922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.851289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189b36-0bfe-4e51-a86a-1b06679a5626 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:41.851919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 180/353] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:41.852928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:41.894906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:41.895619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.895893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.896160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.897829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:41.899341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2f77-494b-4042-87bc-888e20eb6e2e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:41.901898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 174/354] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:41 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:41.903195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:41.903482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:41.903745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:41.924271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:41.925682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:41.952744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:41.969359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6480a-64c9-454c-a9e5-e9b16f71f5c5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.009069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 175/355] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:42.009429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.017276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.017987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.018273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.018546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.020476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.022227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78951f-1aae-4f88-991f-06f0416917b2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.024976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 181/356] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:41 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.025296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11b7e-ef3d-4218-93a8-968053e47192 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.025659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11b7e-ef3d-4218-93a8-968053e47192 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.025985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11b7e-ef3d-4218-93a8-968053e47192 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.027427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 182/357] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:42.028307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11b7e-ef3d-4218-93a8-968053e47192 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.082510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.152970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a63dc-1042-4dde-94ba-254f195a90e7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.164373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11b7e-ef3d-4218-93a8-968053e47192 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.199647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.200748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.201525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.201525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.202478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:42.202882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.204392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.206281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.207921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.208276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.208579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.209778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.211804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.213054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 183/358] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.213857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.220808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 176/359] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.222004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.245872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.337546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0805-e593-42a0-bbef-04c6f6ed3719 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.340790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.341436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb42a-8249-4548-87fb-e533d68acfea None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.377267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.378005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.378828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.379084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.385799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.385955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.386050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.386121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.386381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.386831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24bacc-2d0d-465a-a780-89551e20d073 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.388617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.388751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 184/360] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.389936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.390929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.391212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.391485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.397277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 177/361] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.397277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.414974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:42.416306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:42.497369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 185/362] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:42.498364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.505397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.526982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777180f-d6b4-4e93-a870-53f572ec28cd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.570609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.572306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.572306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.572306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.572851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.574326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.576377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 178/363] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.576625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.631752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.636883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330ebf-55c9-48a7-9c3a-6e02780b7b4f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.690207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.691389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.691715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.692166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] PATH_INFO: `/v3/users/3403f14d77ff49db8dffe8d4fd759cbe` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.693320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] RBAC: Authorizing `identity:get_user(user_id=3403f14d77ff49db8dffe8d4fd759cbe)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.694785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.695396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826a205-cfbf-4767-942d-d5bad8945a90 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.696392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 186/364] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/users/3403f14d77ff49db8dffe8d4fd759cbe => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.699197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.740511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.740868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.741145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.741415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.754387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:42.761687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:42.762615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:42.763395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 179/365] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:42.764046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.786282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.842709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a96b-c3cb-4a8b-a8fa-38b1c164cb12 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.882721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.883252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.883535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.883799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.884545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=044cc590d0254a40912537ba235d27da) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:42.884950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.886351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.887713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9774c3-4a86-4007-af31-3e8573406e0b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:42.895112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 187/366] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.896029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:42.937018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:42.943446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:42.944295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:42.944579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:42.945734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:42.946545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=044cc590d0254a40912537ba235d27da) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:42.946865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:42.948330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:42.956057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 180/367] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:42.956901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.029555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288d3b-303a-47db-9dfb-4f2854da7a35 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.072826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.073455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.073786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.074061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.074944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=65589cf1224e45639928ed2020018be6) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:43.075257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:43.076862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:43.077164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:43.088466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 188/368] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:43.090347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.123893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059a1b6-88e2-42a4-ba63-758800969ff4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.178738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.179413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.179752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.180090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.180900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] RBAC: Adding query filter params (role.id=38e85fc2129244bfab565b6aa7ed9acf, user.id=3403f14d77ff49db8dffe8d4fd759cbe, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:43.181276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:43.182909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:43.196862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 181/369] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 12:46:42 2022] GET /identity/v3/role_assignments?user.id=3403f14d77ff49db8dffe8d4fd759cbe&scope.system=all&role.id=38e85fc2129244bfab565b6aa7ed9acf => generated 510 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:43.197925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.241939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:43.260500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a54b-be59-4dd6-a8f2-8bf4a55afa89 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.349035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.349697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.349975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.350242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.350926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:43.351269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:43.352635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:43.372427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 189/370] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:43.381297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.438542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8575-fa38-4189-a074-8c0a90df7a73 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.510745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.511394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.511668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.511934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.518573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:43.536198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:43.543007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:43.543924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:43.544963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:43.549512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 182/371] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:43.551346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.554164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e2c48-b1fe-44f4-85d1-97a0a3f88df8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.616496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.617104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.617378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.617679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.654488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:43.724898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc85513-ddc0-4f5d-b845-b7a142deb1a5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.734064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:43.735794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:43.787118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:43.787736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:43.788008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:43.788279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:43.789578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:43.789887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:43.791466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:43.808030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 183/372] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:43.815117 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.891042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 190/373] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:43.898318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:43.913166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:43.980700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b19aee-4f29-4423-902a-7f38f36f5b03 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:43.990394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:44.043437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.044288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.044563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.044828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.067282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78980c7-09be-4fe7-9e44-61f4a6874863 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:44.112213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.112213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.112213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.112213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.112915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.115207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.117220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 191/374] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:44.124722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:44.168236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.169998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.283925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:44.332856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b434-98c8-48fb-be6f-8e8c8879311e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:44.369175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:44.369660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 184/375] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:44.375758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:44.404625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.405274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.405579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.405854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.407784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.409268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.414645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 192/376] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:44 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:44.421566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:44.549838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c54f-4b58-4bb7-ac67-25a47c91ec1f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:44.603157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.603788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.604065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.604337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] PATH_INFO: `/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.606484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] RBAC: Authorizing `identity:get_project(project_id=eb4fc2fc9f544519a9c90c5e72e0d4c0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.607916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.609778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 185/377] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:44 2022] GET /identity/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:44.623140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d105f-142b-4544-b71f-a22e6568c51f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:44.634978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:44.687877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:44.707683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.708321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.708565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.708839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.709603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=65589cf1224e45639928ed2020018be6) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:44.709911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.711339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.720932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 193/378] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:44 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 260 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:44.811881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec5365-047d-4a34-82ce-cdf012bc5603 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:44.865626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:44.866272 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:44.866548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:44.866817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] PATH_INFO: `/v3/groups/1e9e6ce414eb41868f428e8ae32490c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:44.874084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] RBAC: Authorizing `identity:get_group(group_id=1e9e6ce414eb41868f428e8ae32490c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:44.875494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5689a1-dc32-4a62-8f72-aba1c41db12c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:44.877391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 186/379] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:44 2022] GET /identity/v3/groups/1e9e6ce414eb41868f428e8ae32490c1 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:44.883775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:44.954472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:45.008795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f79d4-1ec6-4118-97b7-c0a8d7c31d7f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:45.048950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:45.049579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.049861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.050165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.050903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] RBAC: Adding query filter params (group.id=1e9e6ce414eb41868f428e8ae32490c1, role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=eb4fc2fc9f544519a9c90c5e72e0d4c0) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:45.051207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:45.052644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1dba-0df0-48e8-a8ec-405d6ee33488 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:45.058652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 194/380] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:44 2022] GET /identity/v3/role_assignments?group.id=1e9e6ce414eb41868f428e8ae32490c1&scope.project.id=eb4fc2fc9f544519a9c90c5e72e0d4c0&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:45.369620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba9b9-8a38-4f14-bde1-d0c97b7eebdf None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.370265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba9b9-8a38-4f14-bde1-d0c97b7eebdf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.370747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ba9b9-8a38-4f14-bde1-d0c97b7eebdf None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.372535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 187/381] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:45.378388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e463-ce6f-425d-ada5-b220b6db483c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.378677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e463-ce6f-425d-ada5-b220b6db483c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.378940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4e463-ce6f-425d-ada5-b220b6db483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.403617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b2b4e463-ce6f-425d-ada5-b220b6db483c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:45.404797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2b4e463-ce6f-425d-ada5-b220b6db483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:45.408830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6de2-822c-4ab5-9180-508b7db6b46b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.409113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6de2-822c-4ab5-9180-508b7db6b46b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.409958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6de2-822c-4ab5-9180-508b7db6b46b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.411999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 188/382] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:45.417186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b817-e420-407e-bf53-9bca32a0b2ac None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.417469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b817-e420-407e-bf53-9bca32a0b2ac None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.417775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b817-e420-407e-bf53-9bca32a0b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.437762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2f42b817-e420-407e-bf53-9bca32a0b2ac None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:45.439008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2f42b817-e420-407e-bf53-9bca32a0b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:45.512899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 189/383] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:45.527068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 195/384] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:45.692737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd57e-2a3c-4ba8-8b71-9e51f3e42d5b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.693384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd57e-2a3c-4ba8-8b71-9e51f3e42d5b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.693907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cd57e-2a3c-4ba8-8b71-9e51f3e42d5b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.695710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 190/385] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:45.708333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:45.709211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:45.709822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:45.735471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:45.736649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:45.791950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:45.808301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cd57e-2a3c-4ba8-8b71-9e51f3e42d5b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:45.816289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 196/386] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:45.853464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:45.928508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:45.978212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cd57e-2a3c-4ba8-8b71-9e51f3e42d5b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.045307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.046433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.046861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.047282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.059036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:46.064284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:46.065417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:46.067174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:46.069476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 191/387] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:46.075234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.124656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f505-a8f4-4e75-8aa6-80ce06164609 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.170104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.170736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.171447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.171724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.177644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.186261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:46.193819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:46.194978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:46.195868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 197/388] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:46.196598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.208288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e974b-6d57-42b2-abcc-324af979d941 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.246133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.256323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.256929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.257193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.257462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.258157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:46.258455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.260670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.272351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 192/389] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:46.273182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.314982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fefa0-7a88-44dc-94ef-2c407b5c9d39 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.351834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.352464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.352740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.353011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.364277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:46.369169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:46.370070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:46.370847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 198/390] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:46.372083 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.412312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e1499-78bf-4dfe-9731-152de42beaf1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.456591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.458139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.458869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.459378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.460937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:46.461457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.463349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.474381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.477537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae8cf-6aef-41ac-ac14-4288ec89b284 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.478310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 193/391] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.479599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.485445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.525168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.526149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.526622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.527209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.528738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.530392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.532409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 199/392] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.533214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.619027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cde3b8-ed8c-4528-9305-86db51d02a2c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.654224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.654874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.655154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.655434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.656095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:46.656390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.657793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.668584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62e22b-c99e-4302-bbd7-56648c3f97d4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.671717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 194/393] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.672638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.720133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.721228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.721528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.722387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.724669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.726502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.729571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 200/394] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.730519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.754257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.782241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:46.794368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9040dc8-6913-4f02-b850-b645a45b1b36 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.841833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.842647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.843017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.843385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.844640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.846296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.849033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 195/395] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.850166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.880911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8f010-07d0-4a04-9b1f-b62d42c47a2f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.919543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.920287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.920628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.920904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.922160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:46.923851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:46.926734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 201/396] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:46.927848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:46.962575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee93b-b8be-4853-a0f2-44b4cbfad954 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:46.996963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:46.997654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:46.997935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:46.998203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:46.999336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:47.000759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:47.002798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 196/397] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:46 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:47.004092 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:47.008670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:47.050443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9494a-7863-427d-a05e-577bd1354683 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:47.053356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:47.089550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:47.090555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.091020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.091492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.093928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, group_id=6947aeb991d04b31b1d7f43fae6d6539, role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:47.095556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:47.121518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 202/398] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 12:46:46 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:47.121518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:47.121840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b2147-0009-4a7d-8e37-57ef20ad4017 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:47.164389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:47.165031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.165305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.165604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.166792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:47.168338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24534a43-921e-4b60-abb8-f15a92931ff8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:47.175452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 197/399] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:47 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:47.176901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a92-dd5b-479a-b66d-69530b97f9bd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.177183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a92-dd5b-479a-b66d-69530b97f9bd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.177568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a92-dd5b-479a-b66d-69530b97f9bd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.179464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 198/400] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:47.180208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438a92-dd5b-479a-b66d-69530b97f9bd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:47.268406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:47.277069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306db7a-896e-4e88-b75e-b32ac8fa6bd7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:47.310735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438a92-dd5b-479a-b66d-69530b97f9bd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:47.323836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:47.324644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.325088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.325371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.327581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=044cc590d0254a40912537ba235d27da, group_id=6947aeb991d04b31b1d7f43fae6d6539, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:47.329833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db913fb3-7c13-44ff-bdd2-27582bc124b0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:47.350182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 203/401] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 12:46:47 2022] PUT /identity/v3/projects/044cc590d0254a40912537ba235d27da/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:47.351476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.351849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.352171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.353215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:47.354106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.354594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.355218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.357796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, group_id=6947aeb991d04b31b1d7f43fae6d6539, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:47.359594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fe7c7-a0f4-450d-815e-081253743a6a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:47.379731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:47.381361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:47.400727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 199/402] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 12:46:47 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:46:47.404725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:47.406506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c406-acef-43c2-8805-62b7f08dfe5e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.406903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c406-acef-43c2-8805-62b7f08dfe5e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.407189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c406-acef-43c2-8805-62b7f08dfe5e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.408758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 200/403] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:47.416015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:47.416367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:47.416568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:47.437546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:47.438856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:47.470867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 204/404] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:47.564175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 201/405] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:47.839103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:47.855583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:47.939081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:47.970346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43a323-61ae-43e4-878a-8a797a9bd6d7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.002869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992797-1ea5-4e73-9131-2e6256e50792 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.014876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.015736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.016174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.016669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.039150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:48.044663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:48.045535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:48.046331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:48.048764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 202/406] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:48.055207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.062185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.062830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.063106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.063377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.080566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:48.093957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:48.094882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:48.095656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 205/407] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:48.101619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.126641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:48.182699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b20c-b160-45fb-a558-13338677e7f3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.209986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:48.221552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.222915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.223402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.223871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.224768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:48.225264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.226999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.237144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 203/408] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:48.243482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.282793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfffe5-5347-4c80-a73a-ff3c4f4754fe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.351272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.351809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.352086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.352288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50938-db60-4e97-8941-ea18c53894b1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.352411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.353024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:48.353319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.354927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.383769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 206/409] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:48.389302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.392913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.393940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.394431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.394898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] PATH_INFO: `/v3/groups/1e9e6ce414eb41868f428e8ae32490c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.396238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] RBAC: Authorizing `identity:get_group(group_id=1e9e6ce414eb41868f428e8ae32490c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.397959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.400103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 204/410] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/groups/1e9e6ce414eb41868f428e8ae32490c1 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:48.405600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.457880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:48.510709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c877fa-c264-4378-bd8e-9744df57bd70 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.548689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.549729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.550804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.551298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] PATH_INFO: `/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.552708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] RBAC: Authorizing `identity:get_project(project_id=eb4fc2fc9f544519a9c90c5e72e0d4c0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.554460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.556893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 205/411] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:48.562586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.603566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:48.668333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb72f-a6bd-472f-82ca-242a934d5473 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.671051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eb1d4-9b4b-4d95-a4ef-ac588c9395f6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.690436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:48.708818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.709863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.710343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.710851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] PATH_INFO: `/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0/groups/1e9e6ce414eb41868f428e8ae32490c1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.713024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb4fc2fc9f544519a9c90c5e72e0d4c0, group_id=1e9e6ce414eb41868f428e8ae32490c1, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.714815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.735461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 206/412] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 12:46:48 2022] PUT /identity/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0/groups/1e9e6ce414eb41868f428e8ae32490c1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:46:48.749432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.750541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.751017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.751596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.753011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.754744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.756939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 207/413] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:48.762546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:48.896481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbbb80-e93e-4af6-85a4-2c0eba0f968e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:48.935391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:48.936421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:48.936910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:48.937394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:48.938889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:48.940617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f9ef-7e82-4a64-8e64-8510d852c84e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:48.942982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 207/414] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:48 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:48.950749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:49.076722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90889e-42e0-4443-90c8-95aa3c8e617d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:49.117512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:49.118193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.118480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.118769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.121042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] RBAC: Authorizing `identity:create_grant(project_id=65589cf1224e45639928ed2020018be6, group_id=6947aeb991d04b31b1d7f43fae6d6539, role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:49.122559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c7fe9-1da6-472a-81ac-c57cc1321287 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:49.142623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 208/415] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 12:46:48 2022] PUT /identity/v3/projects/65589cf1224e45639928ed2020018be6/groups/6947aeb991d04b31b1d7f43fae6d6539/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:46:49.421735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5358f-288c-4638-9180-65802f4eed0e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.422734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5358f-288c-4638-9180-65802f4eed0e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.423216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5358f-288c-4638-9180-65802f4eed0e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.424759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 208/416] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:49.432471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ccd5-10e6-44fa-8040-b9f9898177e8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.432766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ccd5-10e6-44fa-8040-b9f9898177e8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.433047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ccd5-10e6-44fa-8040-b9f9898177e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.441233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:49.458595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9063ccd5-10e6-44fa-8040-b9f9898177e8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:49.459818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9063ccd5-10e6-44fa-8040-b9f9898177e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:49.567920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 209/417] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:49.766774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e84c-78c4-41c0-8d08-22b6cfa8e3b1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.767061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e84c-78c4-41c0-8d08-22b6cfa8e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.767245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e84c-78c4-41c0-8d08-22b6cfa8e3b1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.768999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 209/418] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:49.782869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.783157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.783430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.810513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:49.811725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:49.857839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622b7-4d2b-4788-919e-deec58b5b003 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.858099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622b7-4d2b-4788-919e-deec58b5b003 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.858410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622b7-4d2b-4788-919e-deec58b5b003 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.860030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 210/419] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:46:49.873975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:49.874496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:49.874857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:49.897304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:49.898872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:49.924052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 210/420] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:49.954139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:49.979289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 211/421] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:46:49.984437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.061683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.114488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c6d8-45f6-4ca8-b341-48d237b2724c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.167160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.167797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.168067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.168332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.184039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:50.189070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:50.189970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:50.191538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 211/422] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:50.197285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.250761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.344055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed215-e61a-419a-8eee-fde95f0c8fb8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.384536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f7a9-3b2c-44de-b2b8-abea63d8f20b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.390473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.391251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.391700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.392630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.393451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:50.394485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:50.396952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:50.408526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 212/423] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:50.415206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.415360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.431004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.432065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.432887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.433659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.447239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:50.454097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:50.455027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:50.455801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:50.457648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.460057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 212/424] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:46:50.461522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.524502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a64b-64df-4cfe-92f3-8eda1133564f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.561319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.562013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.562366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.562710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.574980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:50.579989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:50.580882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:46:50.582299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:50.585614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 213/425] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:50.586448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.591849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f853400-389b-4a08-b79f-c94fcb40e0e6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.631580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.632507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.632999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.633600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.692796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.694906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.696452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f09f-d2c9-46de-940f-f0dccbb9826a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.715128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:50.717001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:50.733712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.734326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.734602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.735200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.735547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:50.735853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:50.737474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:50.747485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 214/426] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:50.748388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.840206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 213/427] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:50.841523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.856399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e69a-9e39-49ca-ac4c-f5df77628f46 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.892018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.892633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.892843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.893120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:50.894611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:50.895307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:50.896384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:50.909770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 215/428] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:50.910696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:50.936307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.937132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:50.958184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211120ce-0f57-447e-915b-7758619fe618 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:50.996082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:50.997643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:50.998125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:50.998596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.022245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b133e-d7b7-4afc-9995-363e76a6ccc9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.060163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.061141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.061622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.062104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.063630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.066037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.068744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 216/429] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.069715 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.078946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.080725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.172187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.173288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.183553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7e23-dd72-4dd4-94cb-514d64739df8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.197544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 214/430] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:51.197544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.219310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.219917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.220221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.220469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.298030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.300451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.303697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ea75-4194-4ba3-968e-08410d445d53 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.338005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.338636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.338917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.339198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.340317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.341795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ad72b-0839-417e-8faa-37887ef7a3e7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.343531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 215/431] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.344616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbed7-2cf0-4289-a1de-838fcd61cfaf None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.344902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbed7-2cf0-4289-a1de-838fcd61cfaf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.345178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbed7-2cf0-4289-a1de-838fcd61cfaf None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.350994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 216/432] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:51.350994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbed7-2cf0-4289-a1de-838fcd61cfaf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.402253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.405151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.417617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 217/433] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:46:51.418652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.460565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbed7-2cf0-4289-a1de-838fcd61cfaf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.500652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.501717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.501997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.502268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.504252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.506035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dec6b-d04a-4bee-92bd-7b9acde27306 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.507972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 217/434] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.509056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.509333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.509624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.528395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:51.529594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:51.532638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d2de-4fa0-4199-8a8e-a226330004ce None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.568744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.569343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.569650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.569922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.571001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=044cc590d0254a40912537ba235d27da) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:51.571001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.572366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.578371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 218/435] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.591227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.609540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 218/436] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:51.609540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.680471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.685213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.740943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508248-0be6-41b2-8840-ef64a6992083 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.754573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ab8be-6fa2-4204-9190-673e08051c4c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.779431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.780056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.780332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.780601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] PATH_INFO: `/v3/projects/044cc590d0254a40912537ba235d27da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.782614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=044cc590d0254a40912537ba235d27da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.783153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276259da-e903-4fcc-8fdf-b2c322e3e1d4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.785625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 219/437] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/projects/044cc590d0254a40912537ba235d27da => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.786755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96539e-a5c7-40a3-bce1-1264f7389740 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.786879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96539e-a5c7-40a3-bce1-1264f7389740 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.787457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96539e-a5c7-40a3-bce1-1264f7389740 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.792280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 220/438] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:51.793453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.793755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.794279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.803912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.804874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.805376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.805927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.807817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.809477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.811239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 219/439] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.811853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.816268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:51.816268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:51.892543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 221/440] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:51.893384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:51.934698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6dd6-bb00-4b65-84a1-605a7bb08284 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:51.952767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.955448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:51.978866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:51.979492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:51.979765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:51.980030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:51.981858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:51.983283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:51.984838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 220/441] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:51.986734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.003690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43422f7-f884-4f81-b5b5-131c2ffb1981 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.040785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.041389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.041712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.041987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.042859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=65589cf1224e45639928ed2020018be6) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:52.043012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.044688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.052010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 222/442] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:52.052781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.121091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97577-e002-4413-aa23-cc1c8393c7b6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.174139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.175110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.175396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.175676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.185266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22835a2-aeb3-4ff3-8bd2-f7afd1df0923 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.193433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:52.202031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:52.203804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 221/443] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:46:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:52.204898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.211239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.234787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.235691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.235969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.236516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.237295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=770fbbc02ae64fba9fac93fc4d59328a, scope.project.id=044cc590d0254a40912537ba235d27da) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:52.237640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.239631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.245798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 223/444] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=044cc590d0254a40912537ba235d27da&role.id=770fbbc02ae64fba9fac93fc4d59328a => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:52.246902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.279544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.341650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6a11-c70a-474a-b239-925f6b7d3f51 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.370664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e091c-8b15-4714-a5e1-6df02cd8bac6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.388480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.389230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.389539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.389817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.403666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:52.409712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:52.409943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:52.410864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:52.411629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:52.412204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.412204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.412204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.412375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 222/445] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:52.412446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:52.412446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.413250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.419638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.427137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 224/446] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:52.433383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.492150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.547780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7049ab-cbaf-456e-ba0b-9c2f255fdbab None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.557935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.577046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9952ad1-4cb4-4f90-95ab-68a14fb01160 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.591376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.591977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.592254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.592526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.593189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:52.593514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.594918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.607199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 223/447] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:52.613027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.619351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.620223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.620570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.620908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.702898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.704495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.740763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427f96-624d-4791-95e6-bf9d84b1163d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.757545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.784059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.784671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.784951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.785223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.830563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:52.836658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 225/448] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:52.842330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.868723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.870226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:52.956800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750097-6a65-454e-9f91-2b6f326a98fc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:52.978881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 224/449] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:46:52.984648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:52.991478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:52.992103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:52.992378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:52.992650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] PATH_INFO: `/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:52.993813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] RBAC: Authorizing `identity:get_project(project_id=eb4fc2fc9f544519a9c90c5e72e0d4c0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:52.995232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.001057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 226/450] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/projects/eb4fc2fc9f544519a9c90c5e72e0d4c0 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:53.002146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:53.014101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:53.053867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:53.088406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69fcb8-35fa-4dbf-90b0-45cda3203012 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:53.104606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5aa2-b17d-47e5-8175-3cd8670925f0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:53.124616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:53.125243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:53.125546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:53.125821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] PATH_INFO: `/v3/projects/65589cf1224e45639928ed2020018be6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:53.127002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] RBAC: Authorizing `identity:get_project(project_id=65589cf1224e45639928ed2020018be6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:53.128955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.130919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 225/451] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:46:52 2022] GET /identity/v3/projects/65589cf1224e45639928ed2020018be6 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:53.135992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:53.138088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:53.138707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:53.138979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:53.139251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] PATH_INFO: `/v3/groups/1e9e6ce414eb41868f428e8ae32490c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:53.140366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] RBAC: Authorizing `identity:get_group(group_id=1e9e6ce414eb41868f428e8ae32490c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:53.141813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.143384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 227/452] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:53 2022] GET /identity/v3/groups/1e9e6ce414eb41868f428e8ae32490c1 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:53.149425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:53.228940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:53.244527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce318cf-b4e6-4e05-ab03-f0934391f523 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:53.253933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d31d0-9ea8-4fb4-8557-e76946506fa7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:53.278432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:53.279055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:53.279337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:53.279610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] PATH_INFO: `/v3/groups/6947aeb991d04b31b1d7f43fae6d6539` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:53.280725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] RBAC: Authorizing `identity:get_group(group_id=6947aeb991d04b31b1d7f43fae6d6539)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:53.282184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.283916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 226/453] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 12:46:53 2022] GET /identity/v3/groups/6947aeb991d04b31b1d7f43fae6d6539 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:53.288530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:53.289129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:53.289402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:53.289611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:53.289818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:53.290547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] RBAC: Adding query filter params (group.id=1e9e6ce414eb41868f428e8ae32490c1, role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=eb4fc2fc9f544519a9c90c5e72e0d4c0) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:53.290873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:53.292269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd06814-0dff-4fb0-9ed9-e0e3e00d972c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.293070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:53.298945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 228/454] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:53 2022] GET /identity/v3/role_assignments?group.id=1e9e6ce414eb41868f428e8ae32490c1&scope.project.id=eb4fc2fc9f544519a9c90c5e72e0d4c0&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:53.400078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea87d26-0142-4b1c-9dab-3f1be3bacb13 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:53.437167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:53.437809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:53.438088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:53.438361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:53.439093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] RBAC: Adding query filter params (group.id=6947aeb991d04b31b1d7f43fae6d6539, role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=65589cf1224e45639928ed2020018be6) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:53.439401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:53.441378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700813f8-a72a-4ddd-a1d9-fd00b90d6912 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:53.447133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 227/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 12:46:53 2022] GET /identity/v3/role_assignments?group.id=6947aeb991d04b31b1d7f43fae6d6539&scope.project.id=65589cf1224e45639928ed2020018be6&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:55.926892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffe4f-cb8b-420d-aa40-29ea08c407a0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:55.927408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffe4f-cb8b-420d-aa40-29ea08c407a0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:55.927408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffe4f-cb8b-420d-aa40-29ea08c407a0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:55.929079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 229/456] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:55.934079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40abe6-fd15-48f0-bf95-e3ffa74b5f92 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:55.934886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40abe6-fd15-48f0-bf95-e3ffa74b5f92 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:55.935358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40abe6-fd15-48f0-bf95-e3ffa74b5f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:55.962557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ef40abe6-fd15-48f0-bf95-e3ffa74b5f92 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:55.964182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ef40abe6-fd15-48f0-bf95-e3ffa74b5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:56.054993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:56.063602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 228/457] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:56.273629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785287-c862-4b58-b03e-19850c62d4f0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.274041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785287-c862-4b58-b03e-19850c62d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.274479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785287-c862-4b58-b03e-19850c62d4f0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.277106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 230/458] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:56.282214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a33337-48e2-45bc-8cf5-ed610134cc84 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.282496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a33337-48e2-45bc-8cf5-ed610134cc84 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.282957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a33337-48e2-45bc-8cf5-ed610134cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.311082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-88a33337-48e2-45bc-8cf5-ed610134cc84 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:56.312565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-88a33337-48e2-45bc-8cf5-ed610134cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:56.400172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 229/459] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:56.503727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60f010-7c74-4e1c-ac58-a5c01977821b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.504343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60f010-7c74-4e1c-ac58-a5c01977821b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.504811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60f010-7c74-4e1c-ac58-a5c01977821b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.506694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 231/460] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:56.514682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a457-7827-45c0-bbde-31718fd64b59 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.516895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a457-7827-45c0-bbde-31718fd64b59 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.517541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a457-7827-45c0-bbde-31718fd64b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.537116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a254a457-7827-45c0-bbde-31718fd64b59 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:56.538612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a254a457-7827-45c0-bbde-31718fd64b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:56.558915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60f010-7c74-4e1c-ac58-a5c01977821b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:56.620715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 230/461] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:56.622349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565039-6db0-47cb-9d7d-f1226fcd95a6 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.622831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565039-6db0-47cb-9d7d-f1226fcd95a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.623281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565039-6db0-47cb-9d7d-f1226fcd95a6 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.624911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 231/462] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:56.635177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.635672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.636094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.670494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:56.672049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:56.719826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60f010-7c74-4e1c-ac58-a5c01977821b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:56.762996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:56.765012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.765296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.765595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:56.774716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:56.778677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:56.780245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:56.782374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:46:56.802891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:56.803820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:46:56.804669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:46:56.804669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:56.804669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:56.804836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 232/464] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:56.804905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 232/464] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:56.807141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:56.810298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:56.953943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325223a-5aa3-4d72-987d-56189476b02b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:56.956768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451642-d235-4fb5-b242-1266ab3febc7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:56.993700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:56.994628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:56.995081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:56.995500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.007504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.009241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.012333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.013232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.013703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.014114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.014919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:57.015364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.017000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:46:57.026538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:57.027609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:46:57.028466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:46:57.028466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.028466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:57.028466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 233/465] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:57.028742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.037614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 233/466] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:46:57.038599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.077057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.104060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.151656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26523d6d-a944-4633-91f9-e9ea4512c9a9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.153302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a1124-4ab5-46fc-8267-46deb91f95c2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.188192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.188801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.189080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.189174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.189356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.189808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.190026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:57.190181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.190954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.191129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.192344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.202457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.208996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.209182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 234/467] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:57.209182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:46:57.224726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:57.225736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:46:57.226563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:46:57.226563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.226563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:57.226563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 234/468] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:57.227328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.329774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.334056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7ad57-1b31-4d52-9e6a-d31887b231c1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.340219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b19e1-ae3b-4dd0-b016-fd4fbe4dd4b7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.348876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.373600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.374643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.375159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.375667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.376828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.379945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.381469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.382123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.382404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.382677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.395966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.397445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.405956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 235/469] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:57 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:57.407300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:46:57.412676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:57.413648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:46:57.414467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:46:57.414467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:46:57.414467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:57.419069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 235/470] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:57.420042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.536233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec934-fb97-4257-942f-3abae6fd3773 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.543210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef995-d99c-4899-a018-a152f25e2d11 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.573081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.573794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.574073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.574344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.575005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.576466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.585594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.586486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.586761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.587028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.587779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:57.588084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.589639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.604837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 236/471] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:57 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:57.605800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.609929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 236/472] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:57.610827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.620912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.639417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.730387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6caec-4e8e-49ad-939b-e774671ad512 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.767298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.768778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.769293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.769780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.770656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:57.771156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.772818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99bb2-2328-4722-8b01-8db3e8f0aa6f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.787539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 237/473] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:46:57.789191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b155-5794-4c02-bcbf-0542f2d0c462 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.789472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b155-5794-4c02-bcbf-0542f2d0c462 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.790387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b155-5794-4c02-bcbf-0542f2d0c462 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.790576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee93adf-6cf2-4cff-96ea-3b514dea510a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.791617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 238/474] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:46:57.796636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b155-5794-4c02-bcbf-0542f2d0c462 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:57.839225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.839762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.840042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.840314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.840967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.843103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f1fd-afbd-4fb7-ab3c-c7eb60594d49 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.877566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 237/475] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:57 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:57.877566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454423-e986-4a0d-b317-fb651a819757 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.877566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454423-e986-4a0d-b317-fb651a819757 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.877566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454423-e986-4a0d-b317-fb651a819757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.903663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-17454423-e986-4a0d-b317-fb651a819757 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:46:57.906135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17454423-e986-4a0d-b317-fb651a819757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:46:57.921171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.946453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b155-5794-4c02-bcbf-0542f2d0c462 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:57.984360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:57.992883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:57.993690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:57.994054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:57.994426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:57.995960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:57.997757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:57.999145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 238/476] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:46:58.041678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 239/477] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:46:57 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:46:58.295392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454423-e986-4a0d-b317-fb651a819757 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:58.403228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454423-e986-4a0d-b317-fb651a819757 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:58.455096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:58.455792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:58.456158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:58.456428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:58.457111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:58.458496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:58.473789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.sql.core [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:46:58.473789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:46:58.473789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [parameters: {'id': '2e1e2f9833374767bb591d07242acbf8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:46:58.473789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Aug 31 12:46:58.494153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:46:58.495231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application yield resource Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise self.value Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application session.commit() Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:46:58.496629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:46:58.497586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:46:58.498621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:46:58.499612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [parameters: {'id': '2e1e2f9833374767bb591d07242acbf8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:58.506471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:46:58.508108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:46:58.509786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 239/478] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 12:46:58 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:58.509907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:58.640018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7166e-b4e0-48c8-bd48-4105305da799 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:58.681003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:58.681582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:58.681863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:58.682133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:58.702848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-524311db-11e5-41ec-b666-7f292d14e679 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:46:58.708859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:46:58.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:46:58.712990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 240/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:46:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:46:58.716750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:46:58.789544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:46:58.836622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a01c-3baa-4703-9323-e15a9897a730 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:46:58.872568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:46:58.873172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:46:58.873445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:46:58.873748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:46:58.874473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:46:58.874772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:46:58.876126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e997603-4dd6-46a6-9aae-523c8ca57309 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:46:58.885336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 240/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:46:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:00.017720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a3f5-0919-4452-9d5e-19084315849d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.018283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a3f5-0919-4452-9d5e-19084315849d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.018283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a3f5-0919-4452-9d5e-19084315849d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.020024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 241/481] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:00.025251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6dc1-6ca5-46d3-a0bc-03f0835227a3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.025736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6dc1-6ca5-46d3-a0bc-03f0835227a3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.025911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce6dc1-6ca5-46d3-a0bc-03f0835227a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.048585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-91ce6dc1-6ca5-46d3-a0bc-03f0835227a3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:00.050349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-91ce6dc1-6ca5-46d3-a0bc-03f0835227a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:00.109508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585653b-665b-4387-870b-0892b7e0ac0f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.109508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585653b-665b-4387-870b-0892b7e0ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.109508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585653b-665b-4387-870b-0892b7e0ac0f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.109508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 242/482] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:00.112452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd380-aab6-4ac2-b49e-4f57ac7da170 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.112889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd380-aab6-4ac2-b49e-4f57ac7da170 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.113277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefd380-aab6-4ac2-b49e-4f57ac7da170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.121225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:00.138990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ecefd380-aab6-4ac2-b49e-4f57ac7da170 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:00.140308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ecefd380-aab6-4ac2-b49e-4f57ac7da170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:00.176029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 241/483] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:00.247777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 243/484] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:00.507662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6f4f8-3319-4077-9186-4940fde38311 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.507999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6f4f8-3319-4077-9186-4940fde38311 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.508221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6f4f8-3319-4077-9186-4940fde38311 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.509627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 242/485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:00.517350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eeda-f0c3-4718-9dfe-c3271288de4b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.517681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eeda-f0c3-4718-9dfe-c3271288de4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.517958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583eeda-f0c3-4718-9dfe-c3271288de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.524845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6f4f8-3319-4077-9186-4940fde38311 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:00.552162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e583eeda-f0c3-4718-9dfe-c3271288de4b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:00.553549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e583eeda-f0c3-4718-9dfe-c3271288de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:00.589689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:00.639542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 244/486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:00.641003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc83d-8778-46f6-9988-aff50531b7af None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.641440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc83d-8778-46f6-9988-aff50531b7af None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.641867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc83d-8778-46f6-9988-aff50531b7af None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.648042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 245/487] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:00.648997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fc83d-8778-46f6-9988-aff50531b7af None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:00.652394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6f4f8-3319-4077-9186-4940fde38311 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:00.699828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:00.700462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.700865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.701141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.714577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:00.715227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d0d16d0f-5e09-49c5-83cc-b03ea34bfc6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:00.720232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:00.721089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:00.722625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 243/488] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:00.724210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.724490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.724761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.746589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:00.748039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:00.759180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fc83d-8778-46f6-9988-aff50531b7af None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:00.796341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:00.797354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:00.797901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:00.798367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:00.809038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:00.814326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:00.815246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:00.816034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:00.821843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 246/489] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:00.822907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:00.829526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 244/490] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:00.838122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:00.907974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:00.982070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bab1e3-1887-4fb7-9c59-081e47eb2230 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:00.998683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44c6f4-a8ae-478a-8ebc-c0ab4bbf58b0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.017324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.017985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.019075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.019075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.020072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.020540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.022123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.031519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 247/491] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.032784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.039551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.040160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.040436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.040708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.041378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.041751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.043121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.054817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 245/492] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.055924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.073855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.160851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff466eb-f065-4bb9-9893-e11f8e837677 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.171554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.176988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c812a-8e61-4f72-93e7-2d8247f4de75 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.198083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.198710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.198982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.199247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.209520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:01.214206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.215061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:01.215836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 248/493] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.216468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.217632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.218274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.218549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.218819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.233152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.234643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:01.249439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.250385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:01.251400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:01.251400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.251400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:01.251400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 246/494] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.251400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.273167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.336235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30670c-5851-45af-b10b-bc01de674d90 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.356509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863433-a7b0-406c-96d5-cc385863486a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.371698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.372322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.372598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.372867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.382986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.384438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.395156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.395786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.396064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.396336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:01.399139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:01.400822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:01.400822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.400822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:01.400822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 249/495] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.401028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.413864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:01.419399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.420244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:01.421008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:01.425917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 247/496] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.426800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.440516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.499987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.506585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36514a5-f7d4-4332-91d0-fdf561fa092f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.528431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b889-38f8-4636-9382-c73944857f7e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.540674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.541277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.541581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.541853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.542513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.542811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.544424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.552286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 250/497] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.553054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.562208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.562802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.563078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.563349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.564017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.564317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.565775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.577219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 248/498] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.578063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.645877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.653310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306d5d-1209-4e70-93d1-5d03a6a11743 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.678144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd06de-cd61-46d9-a229-2fb7d5b23724 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.686944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.687596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.687875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.688145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.688829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.689131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.690626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42254ce-c8a9-4bd7-9916-208b68e8576a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.701815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 251/499] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.702955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e36b6-037f-474f-a121-9afd006d03b3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.703234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e36b6-037f-474f-a121-9afd006d03b3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.703503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e36b6-037f-474f-a121-9afd006d03b3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.704748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 252/500] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:01.705421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e36b6-037f-474f-a121-9afd006d03b3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.719441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.720039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.720311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.720583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.721303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:01.722118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.723607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.724891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.732036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 249/501] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:01.733240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.807463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e36b6-037f-474f-a121-9afd006d03b3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.831671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9813d9-62ee-4d8a-92e4-bfbc6a40454c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.841275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.841996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.842339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.842678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.853356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.854805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.860130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.865879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:01.866486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.866762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.867030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:01.869511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:01.871401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:01.871401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:01.871401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:01.871401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 253/502] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.871619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:01.880662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:01.882136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-cf892337-8ca0-4639-8994-de5a01001e28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:01.895379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:01.896438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:01.897389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 250/503] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:01.897976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:01.897976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:01.898153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:01.915694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:01.916885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:01.944078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:01.974707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61879-6d1b-40ae-a7fa-f1397457eee8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:01.984503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:01.985250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.009611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.010321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.010666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.011005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.019367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.020796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:02.034491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:02.035584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 254/505] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:02.041590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.104143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928c61-b714-433b-80e4-da52bd82f3f2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.128735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.142217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.143105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.144013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.144292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.154073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abbb2-a5d2-4c83-bb53-c3207ebeab92 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.154996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.156447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:02.171657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:02.172564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:02.173382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:02.173382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:02.173382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:02.173382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 252/506] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:02.174360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.186108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.193505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.194111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.194452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.194731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.195385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:02.195697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.197078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.214929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 255/507] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:02.215808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.279185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec1b9-e3a0-41c9-bd84-a5c8be7c6581 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.315105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.316144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.316435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.316720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.317461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:02.317806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.319236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.322294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f170b-c264-4100-9f10-e25c7d27e43a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.356818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.357351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.357665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.357939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.358690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:02.358998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.360463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.362303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 253/508] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:02.364109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.398087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.402702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 256/509] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:02.402990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.451239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.472172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a7b2-b5be-4b81-bc90-6fd8675462e0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.505424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc76ad-f80d-49a5-828c-e2f649c69162 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.507619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.508220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.508497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.508768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.509412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:02.509763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.511139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.526459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 254/510] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:02.526459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.539210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.539838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.540121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.540390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.547637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.549072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:02.561325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:02.562421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 257/511] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:02.563389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.616850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.626893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33576-c281-4333-aedb-1addf6994af5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.660115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.660733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.661008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.661111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91631-ffea-4e3a-ab3c-2c40605ad3f1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.661276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.670000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.672434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.673887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:02.688164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:02.689202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:02.690579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:02.690579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:02.690579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:02.693840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 255/512] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:02.694678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.697856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.698459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.698739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.699010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.764485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.765972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.792557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f748b2-75bc-4a3e-a7ce-e8222018c649 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.825982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.826575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.826851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.827120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.841384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.861460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 258/513] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:02.862892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:02.872959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:02.895333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:02.896781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:02.960945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c4d46-cd54-4b1b-a894-632d59b9c068 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:02.994218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:02.994835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:02.995109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:02.995383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:02.995514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 256/514] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:02.996245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.005971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.007413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:03.018611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:03.019926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 259/515] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:03.020806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.042691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.087908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.098809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ba417-4bec-4aed-9775-481f85dc1273 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.124766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddda5-73e4-4562-adce-641e6677c93a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.135155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.135758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.136035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.136305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.137033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:03.137333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.138790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.155873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 257/516] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 12:47:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:03.156476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.158659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.159263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.159540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.159812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.160465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:03.160769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.162151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.174694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 260/517] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:03.175588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.258449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77439a-751d-40c7-887a-5f77790a6606 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.259927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.277969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f52d6a-f44f-4651-9281-e2e5f9686dca None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.293703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.294571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.294848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.295117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.304966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.305093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.306513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.313455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.314125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.314398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.314698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:03.321460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:03.322465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:03.323281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:03.323281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:03.323281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:03.323281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 258/518] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:03.323495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.325773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.327210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:03.342651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:03.343558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:03.344371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:03.344371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:03.344371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:03.344371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 261/519] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:03.344600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.430379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe15fa-8f06-422e-9088-b9bff0844f95 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.444442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1fa75-73c2-43e4-9d15-b1d104b89228 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.465385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.466019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.466299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.466574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.467310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:03.467620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.469044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.478635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.479329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.479645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.479972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.487121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 259/520] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:03.488343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.503557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.530994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.550627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.552094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.589334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c97e6-2e75-4634-bac8-98515a57130d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.622997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.623594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.623873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.624142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.624785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.626247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.648854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 260/521] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:47:03 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:03.649689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.656719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 262/522] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:03.657640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.741186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.755316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.778176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aa1f-cc86-4033-9c16-a48370689e2f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.785245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc056ee-5b74-4cc7-a0a5-77ee655c55e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.821904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.822515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.822796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.822896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.823069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.823888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.823888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.824064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:03.824064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.824191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.825019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:03.825019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:03.825387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.827411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:03.839861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 263/523] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:03.840556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 261/524] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:03.840759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.841424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:03.951513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96eb1-1736-4fba-908a-bf603828d19c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.951709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954d988-8927-4518-b9c6-14f41d7634ca None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:03.981705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:03.990333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.990640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:03.990964 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.991066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:03.991301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.991408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:03.991558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:03.991659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.003268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.003532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.004975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:04.021189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:04.022177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:04.023010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:04.023010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:04.023010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:04.023010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 262/525] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:04.024061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.070355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.072377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.140370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4088-ba84-4f1b-ad27-0deb1f097d21 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.184888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.185545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.191459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.191615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 264/526] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:04.191789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.191865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.199822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.201685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:04.215591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:04.216454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:04.217293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 263/527] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:04.217823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.233707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.273576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.295022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15e444-111d-4c5e-9973-6a8fb3e62bf9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.342575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.343210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.343489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.343760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.351273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba85bc-e6be-4059-8e76-d712dd7b94cd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.352430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.354210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:04.369574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:04.370536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:04.371361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 265/528] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:04.371820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.404689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.405305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.405620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.405896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.406548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:04.406854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.408239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.422417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 264/529] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:04.423543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.485771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.490303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a442-bdb0-4681-88a5-045d8d314986 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.526819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.527888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.528307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.529155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.529727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.531136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5719d-ef1b-460f-a500-9e45f8d5bb2d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.543617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.545740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:04.561194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:04.562151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:04.562976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:04.562976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:04.562976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:04.562976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 266/530] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:04.563188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.573513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.574382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.574836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.575289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.576590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:04.577086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.579429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.598614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 265/531] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:04.600227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.676827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db149e-451d-4f10-b894-054da3839de7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.716463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.717837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.717837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.718097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.718811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:04.719121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.720558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.722922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324c6b-bdf0-41a1-851d-32fdd0c32e6b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.746282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 267/532] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:04.746282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.760794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.767595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.768301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.768580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.768894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.776360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.777884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:04.789583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:04.790406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:04.791255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 266/533] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:04.792239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.814711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:04.860347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cf3b8-2473-412e-acd2-ff331941974e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.899126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.899736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.900015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.900291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.900939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:04.901153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834e52-5607-4f5f-aeeb-78341d323bf8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:04.901261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.902646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.916253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 268/534] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:04.917591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:04.938733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:04.939510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:04.940464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:04.940637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:04.941765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:04.942085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:04.943507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:04.949656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 267/535] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:04.950423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:05.012426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:05.049718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff54-9781-4230-89a1-63267227e723 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.085904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:05.112899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.113633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.113825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.114097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.114847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=03e8d2a225934b7686b885ec53c71ac3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:05.115155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.116613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.123013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 269/536] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/role_assignments?user.id=03e8d2a225934b7686b885ec53c71ac3&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:05.123975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:05.126880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639392-1bf2-45d3-95ea-3f6e5eab4e0a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.186410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.187076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.187300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.187573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.188380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:05.188690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.190470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.212260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 268/537] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:05.217998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:05.251850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9c7c-4e13-4b83-9fdb-f16f60c448de None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.292293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.293235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.293690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.294384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.297823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:05.304520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.306435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:05.320649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:05.321949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:05.322966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:05.325093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 270/538] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:05.338893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:05.458798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71506aa2-05e8-4dea-94ee-991e7e070afb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.460037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c2d68-e026-40c4-a083-8c9221c9a1b3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.495416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.496022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.496296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.496566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.497268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:05.497596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.499029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.511592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 271/539] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:05.511892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.512453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.512734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.513004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.513763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=68ab75cd2b8f48b7967923b3f875b6db) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:05.514076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.515487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6493-4d2a-4125-b980-9fc456881399 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.522260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 269/540] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:05 2022] GET /identity/v3/role_assignments?user.id=68ab75cd2b8f48b7967923b3f875b6db&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:05.522909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:05.601885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:05.667353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc464e0-75b4-4e36-9dd6-bfe9c6cd5b67 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:05.704731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293dc6d-0e69-4c00-a381-ae1da7ba106c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.705037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293dc6d-0e69-4c00-a381-ae1da7ba106c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.705283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293dc6d-0e69-4c00-a381-ae1da7ba106c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.708127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 270/541] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:05.712164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:05.712466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.712709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.712976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.713701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:05.714200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:05.714667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:05.715597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=ce3ffcb22c2e4dfe8d9341d82c8bb716) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:05.716205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:05.717948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:05.725528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 272/542] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:05 2022] GET /identity/v3/role_assignments?user.id=ce3ffcb22c2e4dfe8d9341d82c8bb716&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:05.745948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:05.747181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:05.749433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:05.847291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 271/543] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:06.190566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:06.321835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42337526-fc3c-41bc-99f8-202a2bfe3563 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:06.343214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:06.362733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:06.363588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:06.364026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:06.364448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:06.383691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:06.389192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:06.390268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:06.391240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:06.393773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 273/544] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:06.399306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:06.548401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f6719-c493-42c8-9ba3-ec91a1033a61 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:06.591611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:06.592446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:06.592893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:06.593301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:06.594127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:06.594561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:06.596557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:06.605508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:06.608478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 272/545] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:06.614876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:06.729250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4a8f-b341-48e8-a390-78f34a2959dd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:06.775162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:06.775795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:06.776072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:06.776343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:06.793039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:06.794809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:06.814250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:06.815185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:06.816009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:06.816009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:06.816009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:06.816009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 274/546] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:06.821367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:06.980080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca87c8-32dd-4740-a6ab-038215d7aa85 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:07.014910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:07.015857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.016328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.016810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.017678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:07.018196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:07.019801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:07.032232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 273/547] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:07.038313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:07.072917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:07.156294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd47fa0-d5d7-4900-bbc8-73311c4ed92d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:07.193345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:07.194142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.194338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.194542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.203884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:07.205714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:07.216936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:07.217861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:07.219396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 275/548] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:07.227052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:07.292788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:07.347669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054c4f-4715-43bc-94ef-db25d3b3d0e4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:07.388438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:07.389046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.389323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.389618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.390348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:07.390652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:07.392339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686a440-3c61-423e-929c-5a28957f192d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:07.416809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 274/549] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:07.422906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:07.522321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:07.531166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b15b-ef27-4801-9eb0-fa35c345da06 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:07.566055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd778-de4c-4ea8-ae43-20c7233dada0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.566331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd778-de4c-4ea8-ae43-20c7233dada0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.566616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd778-de4c-4ea8-ae43-20c7233dada0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.568382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:07.568572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 275/550] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:07.568997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.569274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.569566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.574966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306ee-e887-459f-b57c-873b7d54df95 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.575249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306ee-e887-459f-b57c-873b7d54df95 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.575519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306ee-e887-459f-b57c-873b7d54df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.607309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f70306ee-e887-459f-b57c-873b7d54df95 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:07.608509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f70306ee-e887-459f-b57c-873b7d54df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:07.682209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:07.684009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:07.704870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 276/551] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:07.707175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980dfe-a141-456f-919d-9d2eea347295 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.707682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980dfe-a141-456f-919d-9d2eea347295 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.708146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980dfe-a141-456f-919d-9d2eea347295 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.713741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 277/552] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:07.715666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.716146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.716612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.761585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:07.763107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:07.805100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:07.821648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 276/553] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:07.823302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:07.885084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:07.928845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008f06-9966-47d1-8ec1-c155e4887a9d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:07.953566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 278/554] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:07.974341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:07.974984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:07.975265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:07.975539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:07.993584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:07.995118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7ba551f9-bcde-45a3-b960-a775f548473b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:08.026217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.027182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:08.028041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:08.028041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:08.028041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:08.028041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 277/555] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:08.032957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.036570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ab6-c7a5-47b3-bef1-dbb3976d8ad0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.036860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ab6-c7a5-47b3-bef1-dbb3976d8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.037134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ab6-c7a5-47b3-bef1-dbb3976d8ad0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.038729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 278/556] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:08.044811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217523c-4877-4573-a28f-d135496f2756 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.045097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217523c-4877-4573-a28f-d135496f2756 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.045374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217523c-4877-4573-a28f-d135496f2756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.071750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1217523c-4877-4573-a28f-d135496f2756 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:08.072828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1217523c-4877-4573-a28f-d135496f2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:08.121582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.151544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 279/557] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:08.152496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217523c-4877-4573-a28f-d135496f2756 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.184970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2218-7170-4120-998e-65e41beec5ea None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.228492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.229380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.229876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.230325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.231138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:08.231640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.233710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028967f-6bca-4175-bf4a-8c049f691aa9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.250578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 279/558] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:08.252038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1935e-ea69-4d8e-abf0-81f67d94d294 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.252518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1935e-ea69-4d8e-abf0-81f67d94d294 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.253023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1935e-ea69-4d8e-abf0-81f67d94d294 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.254837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 280/559] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:08.256545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1935e-ea69-4d8e-abf0-81f67d94d294 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.265236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217523c-4877-4573-a28f-d135496f2756 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.302704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.303326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.303600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.303864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.310308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.316965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6b60cff8-46ca-415b-b888-024070e8bfda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:08.322296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.323152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:08.324613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 280/560] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:08.326501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.326501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.326501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.343801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:08.344990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:08.376121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.383756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1935e-ea69-4d8e-abf0-81f67d94d294 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.424770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 281/561] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:08.425676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.430278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.431456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.431916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.432431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.441043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.443715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:08.466655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.467744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:08.468783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:08.470810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 281/562] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:08.471944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.540593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4a5c-3b22-48ef-8896-905c6e911e5f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.576926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.577473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.577794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.578106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.584054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.588075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361328-2f8d-4999-a93b-269c1e0b1219 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.589457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:08.594617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.595572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 282/563] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:08.597341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.627449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.628045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.628320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.628593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.629246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:08.629568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.630913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.635323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.639810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 282/564] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:08.640618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.718618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3781-fe4c-4fae-ac49-860774574430 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.747030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346a986-7f56-4a3a-8204-2316bc9a46d7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.752830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.753454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.753764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.754034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.763788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:08.769160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.770128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:08.770937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 283/565] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:08.771639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.785457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.786097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.786379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.786657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.787356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:08.787663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.789087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.802216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 283/566] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:08.803005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.825767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.861229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:08.877944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903da68-92ed-4cec-92cf-9a7b8260bf01 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.902364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e89b7-b9d0-4860-8e57-22d5f1fefd71 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:08.911079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.911679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.911956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.912228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.912887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:08.913185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.914593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.922629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 284/567] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:08.923403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:08.941824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:08.942446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:08.942718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:08.942988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:08.952745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:08.954199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:08.968911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:08.969942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:08.970904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:08.970904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:08.970904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:08.970904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 284/568] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:08.970904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.024108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5498fb-bd61-46e9-8ee0-0af37f3f7a83 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.040486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.058548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.059181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.059463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.059734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.070136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:09.071607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb618ba5-e219-4a31-ba11-db056f38a205 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:09.075394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:09.076505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:09.077348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 285/569] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:09.081948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.090056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.108106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.108976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.109259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.109561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.110228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.110533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.112539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.120913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 285/570] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.121738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.182747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1a0c-fbfc-48a3-8ca3-4c4a0ad89c67 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.216071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.216677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.216958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.217232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.217982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=f2f1d6fdb382403cb9b9d4c60cf582bb) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.218292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.219712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.221351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cc02d-3830-46be-9131-1a0f44d3f37c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.225119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 286/571] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/role_assignments?user.id=f2f1d6fdb382403cb9b9d4c60cf582bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.226140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.267730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.268420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.268725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.269047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.272109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.283729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.285750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.302662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:09.303264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:09.304118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:09.304993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:09.304993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.304993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:09.304993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 286/572] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:09.305213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.341473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dc314-ab07-4a04-ab18-5732bd896cde None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.381463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.382061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.382345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.382615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.383268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.383569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.384944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.397618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 287/573] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.398452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.423553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079cdb-058b-4f5f-b7ef-ef1310742334 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.460745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.462154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.462579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.463030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.464123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.464425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.465817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.479186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 287/574] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.479186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.509478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58621-22d0-48eb-a2db-3e9d60fde57b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.532838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.539966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.546757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.547383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.547659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.547928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.558165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.559650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:09.575068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:09.576206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:09.577072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:09.577072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.577072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:09.577072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 288/575] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:09.577307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.598212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c123-681b-4734-9800-3a91fd0366cb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.635606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.636231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.636560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.636937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.637652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.637950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.639411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.656877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 288/576] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.657781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.685565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aaa71-d95c-44ce-9825-69a7861915d4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.726532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.727434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.727717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.727992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.738784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.740756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:09.756584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:09.757579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:09.758527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:09.759849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612851-b587-44e8-8150-ea04d69ed891 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.761642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 289/577] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:09.762671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.771911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.798591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.799703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.800039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.800317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.808834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:09.811659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.813418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:09.830685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:09.831865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:09.832748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:09.832748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:09.832748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:09.837026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 289/578] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:09.837708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.872383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae792e-0090-4235-877f-6931d46f24d5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.909468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.909751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.910029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.910309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.910954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:09.911256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.912619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:09.925084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 290/579] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:09.925914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:09.951405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c145b6-997a-4bef-ac65-bf2a350d5359 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:09.989539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:09.990258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:09.990540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:09.990813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:09.998126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:09.999536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:10.011462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:10.012383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 290/580] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:10.013327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.040033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.042154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be627cc-5849-4401-a58f-67a26897ed1a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.045414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.087354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.087995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.088276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.088543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.089277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.089616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.091045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.112795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 291/581] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.113767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.134985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733626-1da0-487d-8172-da2e00abce8d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.180337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.181143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.181430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.181918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.182607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.182910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.184261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.202458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 291/582] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.202458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.225052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97888a-5473-452e-84be-6d8c87c2b9b8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.261374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.262025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.262304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.262576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.270368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.271761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:10.283918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:10.284966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:10.285940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 292/583] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:10.286510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.290089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.312902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13468d-f6a1-4163-b0ee-afc9540d6735 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.317024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.348791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.349393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.349718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.349994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.350729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.351034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.359394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.381592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 292/584] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.382551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.413327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5787a0-6e2b-4908-b8ac-aaae6f2e2f84 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.448452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.449006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.449284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.449597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.467770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.469308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:10.485276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:10.487126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:10.488258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:10.488258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:10.488258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:10.488258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 293/585] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:10.488523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.490512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5028e-eb38-4031-a903-679ff13020d3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.526686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.527312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.527592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.527865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.535970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.537414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.539245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:10.552381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:10.553590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:10.554568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 293/586] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:10.555158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.568565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.604069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0067-05ec-4bf3-8558-73ba2a0775c9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.641900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.642833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.643116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.643401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.644130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.644438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.645896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.669277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 294/587] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.669277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.669562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bddd8-5ded-4a97-bc72-92da694c9e05 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.705024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.705868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.706275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.706621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.717366 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.718933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:10.733621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:10.734745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:10.735829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:10.735829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:10.735829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:10.740168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 294/588] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:10.741040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.787094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41d9c-b763-498d-abaa-b0ad455ef8d6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.799589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.818264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:10.824741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.825476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.825883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.826252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.826995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.827394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.828846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.845908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 295/589] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.845908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.859606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8618-48b1-404f-b0b3-bf455ed20769 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.895646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.896255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.896534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.896809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:10.897576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:10.897882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:10.899311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:10.917943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 295/590] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:10.918588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:10.957128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ec680-37cc-48d7-bb46-420f04b0dd18 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:10.991003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:10.991632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:10.991917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:10.992187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.003533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.004989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:11.020042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:11.021186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:11.022323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:11.022323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:11.022323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:11.025743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d392dc-b0b8-4d4c-852d-8e4e5e4896b0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.025867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 296/591] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:11.026659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.036471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.064456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.065886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.066235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.066572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.067292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:11.067596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.068951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.070945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.085866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 296/592] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:11.085866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.157323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401de6-33c3-41c1-a326-d66539a4337b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.191643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.192261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.192536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.192802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.193907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f995ac-f456-4f87-808b-1595788272f0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.199258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.200690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:11.211893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:11.212977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 297/593] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:11.214129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.231305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.231922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.232204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.232475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.243329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.244798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:11.259107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:11.260176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:11.261037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:11.261037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:11.261037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:11.261037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 297/594] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:11.261266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.284088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.320889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268537a4-078d-444d-a670-f9628c729e1f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.322489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.354745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.355339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.355613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.355881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.356517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:11.356811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.358180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fd97-ee09-4908-bb34-d7494b09181f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.362241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f494d6-ed6c-4aea-bc7c-fc34b444c3d2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.370085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 298/595] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:11.371380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b19af-6c3f-4412-98a6-9e7378f066a8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.371670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b19af-6c3f-4412-98a6-9e7378f066a8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.371941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b19af-6c3f-4412-98a6-9e7378f066a8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.377920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 299/596] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:11.378720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b19af-6c3f-4412-98a6-9e7378f066a8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.397772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.398398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.398677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.398952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.405470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.406994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:11.418975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:11.419911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:11.420833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 298/597] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:11.421379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.482385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b19af-6c3f-4412-98a6-9e7378f066a8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.501731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.516019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.516578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.516854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.517126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.518387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:11.518693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.520108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.521854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ab1f-3b14-416b-ac0d-90d40d997db4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.531231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 300/598] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:11.532025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.560493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.565172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.565955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.566225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.566494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.567132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:11.567434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.568778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ab01-6dd0-4a29-9874-d08fae100aee None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.580180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 299/599] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:11.581451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.581759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.582030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.600025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:11.601217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:11.636928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de382-827a-49f8-ba45-061987ea555b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.666680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 300/600] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:11.669972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.670446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.670600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.670879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.671160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.678655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.680085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:11.691681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:11.692687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:11.693624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 301/601] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:11.694104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.741556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.776076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f44c72-20ea-489e-948b-96cea07e13f9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.789413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:11.810076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac4cfd-fbc3-418c-993f-6768fea7de86 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:11.825688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.826650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.827001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.827341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.828362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:11.829106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.831783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.847298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 301/602] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:11.847466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:11.848216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.848448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:11.848878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:11.849155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/03e8d2a225934b7686b885ec53c71ac3/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:11.869951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=03e8d2a225934b7686b885ec53c71ac3, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:11.871478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:11.886695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 302/603] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:11 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/03e8d2a225934b7686b885ec53c71ac3/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:11.887312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:11.987176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069030-39ac-4dd4-9620-6061916c5910 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.012556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254423f-1e6f-4314-8f04-899e70795175 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.016382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.023933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.024867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.025319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.025796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.036128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.037904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:12.050735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:12.051625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:12.052503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 302/604] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:12.052976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.053048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.062683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.063410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.064010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.064353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.065823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:12.066232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.067773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.082312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 303/605] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:12.085632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.172312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6930d8-b7dc-4944-ad8f-068b759e7d99 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.213242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.213459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e997f4-e49b-480b-81ff-ea57487d8647 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.214186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.214568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.214921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.229898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=e4e7f0ac2d354e1eac91ab2b91e5a89b, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.231418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.253520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 303/606] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:12 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:12.253520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.260131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.260928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.261310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.261716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.279146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:12.285093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:12.286292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:12.287319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:12.289319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 304/607] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:12.290332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.313292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.374585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.390340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc2a52-c1ec-40a9-9613-f5151bbabd2d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.434604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.435217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.435497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.435770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.436469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:12.436772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.438853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.438969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dc22e-69d0-4593-b0ae-1d2ab418e1ac None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.452287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 304/608] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:12.453134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.508415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.509329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.509776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.510589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/68ab75cd2b8f48b7967923b3f875b6db/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.531493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=68ab75cd2b8f48b7967923b3f875b6db, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.533826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.552458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 305/609] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:12 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/68ab75cd2b8f48b7967923b3f875b6db/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:12.553960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.576539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.587920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da2c33-ee68-414a-b744-4e813b7d6635 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.687152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.687779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.688058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.688327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.689016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:12.689317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.690894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38a11-9726-437f-a113-56410038bc9f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.691936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.692814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:12.715951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 305/610] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:12.725406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:12.774790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.775469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.775750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.776022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/ce3ffcb22c2e4dfe8d9341d82c8bb716/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.822955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=ce3ffcb22c2e4dfe8d9341d82c8bb716, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.824331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.842012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9963a8-54eb-4af2-995a-3f3adf004132 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:12.872026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 306/611] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:12 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/ce3ffcb22c2e4dfe8d9341d82c8bb716/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:12.881167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:12.882124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:12.882571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:12.882993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:12.902466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:12.904460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:12.925883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:12.930649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:12.931513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:12.931513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:12.931513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:12.931513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 306/612] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:12.936360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:13.084954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e272-afa5-43aa-8bfd-499c6031eb43 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:13.124821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:13.125430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:13.125732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:13.126002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:13.126647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:13.127273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:13.130214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:13.140449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 307/613] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:13.146574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:13.174599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:13.252029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea971-8d8a-4049-ba20-f5ce541cd3f5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:13.285915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:13.286537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:13.286813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:13.287079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:13.294842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:13.296346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:13.308286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:13.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:13.310427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 307/614] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:13.315456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:13.331249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:13.472971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f6982-21ec-4bc8-a702-c59c6f5d5c54 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:13.524569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:13.525424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:13.525877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:13.526295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:13.527200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:13.527654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:13.529225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:13.554873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 308/615] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:13.560015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:13.653919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:13.681133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211f452-64eb-4b55-8758-56591ac1e6ef None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:13.717787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:13.718473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:13.718753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:13.719026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:13.730550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:13.731987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:13.747372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:13.748364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:13.749441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:13.749441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:13.749441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:13.749441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 308/616] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:13.755506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:13.826885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:13.859311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aebf2-1841-4400-8e2e-0803d44a7271 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:13.897058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:13.897704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:13.898025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:13.898296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:13.898939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:13.899236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:13.900663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:13.912940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 309/617] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:13.918436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:14.024870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4722a-02f1-46e2-8ef5-7a3e521cc85b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:14.058259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:14.061003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:14.061752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.062036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.062347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.070418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:14.071912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3a9536eb-416f-4d26-91c6-f55fafc415a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:14.083911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:14.084795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:14.086256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 309/618] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:14.091031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:14.195126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b06d-f7a2-4fa4-9a88-f3e0a34bacbe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:14.228798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d00f-b064-4930-ac65-faaa6f0d7a74 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.229139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d00f-b064-4930-ac65-faaa6f0d7a74 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.229339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d00f-b064-4930-ac65-faaa6f0d7a74 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.230936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 310/619] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:14.239035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c66-07fd-418e-8e9c-65bf0aeb4857 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.239311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c66-07fd-418e-8e9c-65bf0aeb4857 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.239582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c66-07fd-418e-8e9c-65bf0aeb4857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.245615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:14.258124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:14.258742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.259018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.260870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.261627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:14.261939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:14.265635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:14.270642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a35c8c66-07fd-418e-8e9c-65bf0aeb4857 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:14.271828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a35c8c66-07fd-418e-8e9c-65bf0aeb4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:14.292128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 310/620] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:14.303107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:14.440496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 311/621] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:14.441572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70de8ba-d5c9-4469-98d2-18fb84b6cd6e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:14.478113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:14.479043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.479321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.479642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/f2f1d6fdb382403cb9b9d4c60cf582bb/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.498152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=f2f1d6fdb382403cb9b9d4c60cf582bb, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:14.499635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cd221-dc4c-40dc-be81-048ec74763d2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:14.515080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 311/622] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:14 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/f2f1d6fdb382403cb9b9d4c60cf582bb/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:14.713066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d7d7c-6c31-457f-b037-3808b670cca5 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.713651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d7d7c-6c31-457f-b037-3808b670cca5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.713651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d7d7c-6c31-457f-b037-3808b670cca5 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.715313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 312/623] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:14.721222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931620ff-fb35-4ddb-a357-66c780655f1c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.721544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931620ff-fb35-4ddb-a357-66c780655f1c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.721827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931620ff-fb35-4ddb-a357-66c780655f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.742653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-931620ff-fb35-4ddb-a357-66c780655f1c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:14.743852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-931620ff-fb35-4ddb-a357-66c780655f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:14.781243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:14.826005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 312/624] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:14.841648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d7d7c-6c31-457f-b037-3808b670cca5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:14.902943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81beb-205f-4fd4-860d-a04ebb220dc3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.903276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81beb-205f-4fd4-860d-a04ebb220dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.903486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d81beb-205f-4fd4-860d-a04ebb220dc3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.904965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 313/625] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:14.910173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580674-e6c4-40d6-9891-39891181526f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:14.910719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580674-e6c4-40d6-9891-39891181526f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:14.911188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580674-e6c4-40d6-9891-39891181526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:14.930285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-44580674-e6c4-40d6-9891-39891181526f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:14.931862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-44580674-e6c4-40d6-9891-39891181526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:14.982166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d7d7c-6c31-457f-b037-3808b670cca5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.001691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.034445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.035876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.036579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.038101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.057850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:15.066066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 314/626] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:15.071113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:15.072015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:15.072855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 313/627] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:15.075053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580674-e6c4-40d6-9891-39891181526f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.186548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.259308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.262309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580674-e6c4-40d6-9891-39891181526f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.316488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.317106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.317386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.317689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.318364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:15.318668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:15.320033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:15.331236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 315/628] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:15.336539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.364140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b40ea-1013-4d82-85e5-02be7d69bbc3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.419362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.419996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.420276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.420547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.432973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:15.438338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:15.439259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:15.440376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 314/629] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:15.446903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.496890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.508239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc672e0-7ab8-459b-872b-d33e7b5a78d5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.550316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.551274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.551555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.551829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.566103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:15.567997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:15.578036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cf80-db5e-469c-9262-582214c3cdf6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:15.586561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:15.587623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:15.588949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:15.588949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:15.588949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:15.588949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 316/630] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:15.589188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.606314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.618251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.618913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.619192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.619470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.631649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-01caa4d9-9210-4210-a866-30123d84adeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:15.636913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:15.638163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 315/631] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:15.639504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf069-5548-4a22-a5dd-70ebdc8524d9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.640449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf069-5548-4a22-a5dd-70ebdc8524d9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.640449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf069-5548-4a22-a5dd-70ebdc8524d9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.649534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 316/632] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:15.649534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bf069-5548-4a22-a5dd-70ebdc8524d9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.707118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bea78-aad2-4780-b8cc-6f7119e97fd5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.742496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.743054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.743976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.744379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.744743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.745574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:15.745850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:15.747218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:15.751569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bf069-5548-4a22-a5dd-70ebdc8524d9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.756527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 317/633] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:15.757158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.791911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.792522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.792803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.793078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.794009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:15.794312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:15.795669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb650e-4229-464b-bc4b-2a106d8f6ca1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:15.807986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 317/634] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:15.813464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.813776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.814059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.834481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:15.836593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:15.842858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:15.868407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545342-5a33-4ae4-925c-a3d73d75619d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:15.906188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:15.906799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:15.907078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:15.907353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:15.908047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:15.908924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:15.909469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 318/635] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:15.910170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:15.910271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:15.926622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 318/636] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:15.926622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.031138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.039630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1451-622b-437e-9d1d-fafb10c729e0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.049197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a87f8-8b7d-4f60-a5f2-9567b0ca6e7c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.084868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.085514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.085796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.086066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.086603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.087386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.088072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.088496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.097864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.099518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.101551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.108499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.110262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:16.116000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:16.117113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:47:16.118261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:16.123786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 319/637] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:16.123786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:16.136304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:16.137387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:16.138795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:16.138795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:16.138795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:16.141001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 319/638] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:16.146552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.246429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc87c7-7d9f-435d-9650-98666aa2df63 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.262858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93041294-21df-4923-993a-eaeb6df91676 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.282753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.284041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.284326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.284601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.296206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.297693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.299420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.299853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.300122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.300388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.301116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:16.301416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.302834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.311360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:16.312787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:16.313904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:16.314873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:16.314873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:16.314873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:16.314873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 320/639] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:16.319486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.324395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 320/640] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:16.325069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.379768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.434633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d37e-6ca7-4105-80c1-5b4ac317b27b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.448256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ed9d0-87ee-4a13-85d4-1f3fb6a41130 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.472157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.472771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.473053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.473337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.474014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:16.474322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.475804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.487873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.488425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 321/641] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:16.489013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.489250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.489660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.489985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.504445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:16.509678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:16.510660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 321/642] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:16.514497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.573867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.610566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860d73-6ca8-437f-b1e0-95984c443017 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.621824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be08e-0ade-4f1b-9e91-2a6d1a411bda None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.622894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.649227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.649860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.650134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.650400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.651043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:16.651340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.652707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.659977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.660769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.661215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.661501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.664486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 322/643] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:16.665438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.751014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.753124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.777421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc827e7-3efa-417d-8130-f36ee23c9e22 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.808101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.811798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.812428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.812707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.812982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.821087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.822571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:16.834655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:16.835710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 323/644] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:16.837572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.855470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 322/645] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:16.856306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:16.875725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:16.945645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0b23-fff9-4d1e-86e4-ec9e87bb7237 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.954814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332f04-f6fd-408f-a8c2-045b1947d9b0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:16.978849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.979452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.979740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.980016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.980676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:16.980980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:16.982387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521af8-8fd9-47ff-8176-9b57bc2c1eb3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:16.989124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:16.989768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.990047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.990319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.990419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 324/646] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:16.991582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae51fd-5a66-4aa0-bd4c-95f2a9076ee2 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:16.991873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae51fd-5a66-4aa0-bd4c-95f2a9076ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:16.992148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae51fd-5a66-4aa0-bd4c-95f2a9076ee2 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:16.993344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 325/647] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:16.994061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae51fd-5a66-4aa0-bd4c-95f2a9076ee2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.000650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.003244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:17.014744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:17.015830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:17.016754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 323/648] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:17.017338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.035096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.092742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.104056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae51fd-5a66-4aa0-bd4c-95f2a9076ee2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.120392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cf-3698-40ed-8ba6-7c66f35d44c3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.137324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.137970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.138254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.138530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.139259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:17.139566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.140989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.153349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.154005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.154282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.154554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.157788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 326/649] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:17.159158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.166541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.167968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-0018d579-288e-4b0e-b386-d8d553a7c6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:17.184243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:17.185385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:17.186312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:17.186312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:17.186312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:17.186312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 324/650] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:17.186792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.187012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.187284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.204541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:17.205871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:17.271148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14ec15-a2a7-48b8-b0df-6726d8031ecd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.272771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.279718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 325/651] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:17.280813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.310831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.311473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.311757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.312035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.322706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.324164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:17.339852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:17.340825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:17.341754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:17.341754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:17.341754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:17.346637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 327/652] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:17.347587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.350387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.407470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228e27a-a030-4b09-a9be-f3a0a8960cd2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.458845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.459417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.459697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.459970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.460713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:17.461016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.462525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.466159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bba69-b7f0-49c4-8f80-85e992efa264 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.481198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:17.482005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.508819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.510261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.510765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.511381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.556529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.600363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.601984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.604157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.608226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498a94d-cdf8-493c-ad29-f790c7580b7e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.642086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.643475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.643749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.644020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.644653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:17.644948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.646317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.657111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 327/654] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:17.657921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.703468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 328/655] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:17.704369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.760712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502161e-e685-4a4d-887f-46acf22404c1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.777822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.795465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.796059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.796332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.796601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.797250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:17.797562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.799099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.800883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56828f1e-0229-4002-b734-a884782f0bb6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.802418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:17.810311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 328/656] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:17.811111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:17.836768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.837370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.837685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.837961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.903836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:17.905267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:17.909815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88125754-abdd-4962-b737-b1f920908f7b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:17.943596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:17.944230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:17.944510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:17.944785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:17.955925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:17.960724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:17.961691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:17.962549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 329/657] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:17.963266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.000028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.022669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 329/658] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:18.023436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.025632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.071023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4970-9762-46dd-a17c-c1e91731ef0f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.104252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.104885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.105163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.105430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.112699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.114167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.125347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebce959-f429-45fe-90c7-e345a1ee1d9c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:18.125917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.127546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 330/659] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.128424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.164097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.164756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.165040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.165315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.176278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.177776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:18.193748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.194736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:18.195626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:18.195626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.195626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:18.195626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 330/660] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.195867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.226758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.233603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445d56c-ae5e-4457-8333-da1f10f8db44 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.250106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.267813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.268511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.268787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.269052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.276244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.277633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:18.289403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.290393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:18.291301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:18.293861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 331/661] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.294811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.295914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bed14-9dc5-4d7f-9aed-5695deb8d926 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.329445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.330296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.330580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.330852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.331513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.331815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.333168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.341127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 331/662] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.341853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.395035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300576df-ddd2-410b-95f0-eab63b1ee833 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.428581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.429197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.429474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.429779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.440417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.440549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa18ad-b6a1-40ac-be1d-e3b514508d51 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.441867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:18.456133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.457112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:18.458585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:18.458585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.458585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:18.458756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.458828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 332/663] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.458828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.469351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.476484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.477118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.477399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.477695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.478389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.478721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.480150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.493324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 332/664] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.494165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.563873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d18-2150-4886-9f91-afa9bce43796 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.594418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac6455-d6aa-4386-b42e-a85e6edc9ecb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.596871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.598116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.598406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.598687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.599335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.599640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.601030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.613269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 333/665] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.614100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.630163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.630770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.631050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.631325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.632063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.632385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.633892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.650735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 333/666] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.651535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.680567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.686337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.713634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555335-9392-4a8b-b344-54325d675296 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.746868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.747488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.747766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.748039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.749862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1420df7-c877-4b2b-8aba-20de60cd0a8b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.757935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.759370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:18.774993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.776503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:18.777630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:18.777630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:18.777630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:18.780978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 334/667] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.781819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.783537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e415c-1968-400d-8b08-e787379f036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.784134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e415c-1968-400d-8b08-e787379f036a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.784412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e415c-1968-400d-8b08-e787379f036a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.784679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e415c-1968-400d-8b08-e787379f036a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.785320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e415c-1968-400d-8b08-e787379f036a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.785658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e415c-1968-400d-8b08-e787379f036a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.787019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e415c-1968-400d-8b08-e787379f036a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.799047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 334/668] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.800014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e415c-1968-400d-8b08-e787379f036a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.889435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1797c-c5ba-42b6-a585-64813c839023 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.895816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.902886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e415c-1968-400d-8b08-e787379f036a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:18.909994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:18.924606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.925202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.925477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.925780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.926492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=03e8d2a225934b7686b885ec53c71ac3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:18.926796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.928201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.933903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 335/669] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/role_assignments?user.id=03e8d2a225934b7686b885ec53c71ac3&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:18.934672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:18.935698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:18.936317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:18.936592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:18.936959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:18.944152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:18.945717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:18.958594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:18.959754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:18.960648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 335/670] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:18.961168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.055188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633f8a-9eef-41b2-afd6-acbd37392576 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.075071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceedfb-7d8a-43e4-a259-d6ba2a876917 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.096220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.096589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.096965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.097245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.121271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.121921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.122204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.122479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.123134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:19.123441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.124804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.139318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 336/671] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:19.140347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.158006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.163253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.184384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.185863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.255079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f7095-650b-4caa-9f33-43ee6d675fe5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.291896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.292535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.292818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.297647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.297786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 336/672] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:19.297786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.302258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.303823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:19.316798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:19.317761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:19.318646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 337/673] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:19.319130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.390152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.400609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.409036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a056d67-30cd-4779-9a2f-ae9d2a5410d6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.431954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf332fe8-1a2c-41e1-b0fc-24cc145ff1bf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.444606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.445215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.445506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.445796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.446489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:19.446801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.448308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.460801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 337/674] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:19.461645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.476360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.477313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.477632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.477927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.486937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.488384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:19.500107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:19.501046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 338/675] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:19.506735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.575795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca878-b88c-4684-9b4f-db7510a8f094 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.608959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f795788-817a-4ab6-befa-851544a77f46 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.610795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.612111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.612403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.612675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.624168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.625740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.629306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:19.642997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:19.644003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:19.644900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:19.644900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:19.644900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:19.644900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 338/676] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:19.645132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.651000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.651560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.651839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.652110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.652827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:19.653133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.654700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.656526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.669455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 339/677] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:19.670349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.758278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d78a5-c83a-4081-8505-4bbea18b5dd6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.774312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5abdb-4e2d-4177-9596-a31ecd0ff61f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.795177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.795922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.796333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.796609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.797526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:19.798146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.800151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.813523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 339/678] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:19.813523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.817895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.818615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.818964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.819310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:19.820140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:19.820520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:19.822141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:19.843562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 340/679] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:19.844610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:19.884328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.904037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:19.946084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052ea86-b464-44f4-a9ad-979329714678 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.963561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090be93b-db2c-49fd-8c1c-9ef84b8bb493 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:19.997050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:19.998152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:19.998535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:19.998815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.000590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:20.001342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.003929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.009433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.011003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.011003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.011003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.011800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=68ab75cd2b8f48b7967923b3f875b6db) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:20.012208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.019479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.023363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 341/680] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/role_assignments?user.id=68ab75cd2b8f48b7967923b3f875b6db&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:20.024372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.025596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 340/681] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:20.034194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.159343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbfa2c-e711-4402-b398-0e14a1d48441 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.178570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:20.183704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5063-1fe5-43d4-a865-69853dcd7f4f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.199792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.200407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.200685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.200955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.211726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:20.232605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.233593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.234074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.234535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.243676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.245418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:20.260632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:20.261628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:20.262617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:20.264326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 341/682] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:20.270638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.281086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.283235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.388241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42afd31-b4c8-4234-b1cf-125ae75fc570 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.416830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 342/683] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:20.422566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.425345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.426170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.426596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.427015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.427862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:20.428332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.429984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.440446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:20.448110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 342/684] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:20.449685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.505193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:20.574474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553c54c-e618-4bcb-82b7-fdf65585d6bf None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.575904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eba28-9d17-4b5d-9a50-1e2ab827374f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.613229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.613849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.614123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.614391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.615121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=ce3ffcb22c2e4dfe8d9341d82c8bb716) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:20.615418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.616832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.629828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 343/685] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/role_assignments?user.id=ce3ffcb22c2e4dfe8d9341d82c8bb716&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:20.650656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.651301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.651576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.651843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.664289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.665816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:20.683091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:20.684241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:20.685356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:20.685356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:20.685356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:20.685356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 343/686] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:20.692342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:20.848441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3637-e309-4cc3-a046-72085a26109c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:20.854742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:20.902183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:20.902791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:20.903064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:20.903333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:20.903976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:20.904270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:20.905653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:20.923512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 344/687] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:20.925642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:21.019059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:21.069099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a40a1-f068-47a3-8dbf-8726b9a44169 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:21.110899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:21.112237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.112624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.112898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.120009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:21.121436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e81b17c4-71cb-4ed7-8f39-a91d7c6db681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:21.133655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:21.134529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:21.135410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 344/688] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:21.141098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:21.153227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f35e-c035-43d8-9601-98fd155a94a7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.153564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f35e-c035-43d8-9601-98fd155a94a7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.153835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f35e-c035-43d8-9601-98fd155a94a7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.155423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 345/689] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:21.160599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.160883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.161161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.180719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:21.182055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:21.259944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 346/690] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:21.261517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a0d3-4d9c-48f8-8b75-6a4b25c3e0f8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:21.297305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:21.297855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.298136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.298918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.299623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:21.299924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:21.301326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:21.313389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 345/691] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:21.319783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:21.390544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:21.449929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf818b-4405-4e3b-8083-39ab98b18354 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:21.493526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:21.494160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.494432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.494701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.495519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=f2f1d6fdb382403cb9b9d4c60cf582bb) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:21.495824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:21.497344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:21.510690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 347/692] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:21 2022] GET /identity/v3/role_assignments?user.id=f2f1d6fdb382403cb9b9d4c60cf582bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:21.672670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:21.700240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:21.784166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82541-60e6-4186-8b56-8f4bf0c63162 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:21.826390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:21.827023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:21.827311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:21.827590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:21.840103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:21.841606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:21.857885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:21.859275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:21.860175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:21.860175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:21.860175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:21.860175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 346/693] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:21.866499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:21.978256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129901-00fd-41c4-adf2-db11a3c59328 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:22.003261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:22.020796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:22.021413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.021728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.022007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.022663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:22.022967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:22.024333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6a94-f6af-4f4e-9cd7-eb160e301275 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:22.038296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 348/694] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:22.043773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:22.135338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:22.161109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f987-e33a-49c3-8c66-478a63b5de7f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:22.204825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:22.206105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.206393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.206719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.207390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:22.208890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ae940-e285-44f3-b7f9-37a2718befe8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:22.253972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 347/695] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:47:22 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:22.396801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd8475-5d0e-4dda-9658-193741c3e02d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.397127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd8475-5d0e-4dda-9658-193741c3e02d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.397357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd8475-5d0e-4dda-9658-193741c3e02d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.399067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 349/696] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:22.404337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c9be3-6e97-45b1-bb12-b7da942d3cfb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.404625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c9be3-6e97-45b1-bb12-b7da942d3cfb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.404902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c9be3-6e97-45b1-bb12-b7da942d3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.436988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fe3c9be3-6e97-45b1-bb12-b7da942d3cfb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:22.438203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fe3c9be3-6e97-45b1-bb12-b7da942d3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:22.518844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 348/697] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:22.542853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344d81-d345-4b4d-9fd1-0b16d1a9ba58 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.543153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344d81-d345-4b4d-9fd1-0b16d1a9ba58 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.543408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344d81-d345-4b4d-9fd1-0b16d1a9ba58 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.545892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 350/698] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:22.552474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.553067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.553643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:22.573140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:22.574797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:22.651754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:22.667690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 349/699] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:22.816023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344d81-d345-4b4d-9fd1-0b16d1a9ba58 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:22.944892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344d81-d345-4b4d-9fd1-0b16d1a9ba58 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:22.987772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:22.989262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:22.989758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:22.990306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.005636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:23.010831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:23.011745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:23.012570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:23.014855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 351/700] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:23.021452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.150254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767d80-a565-469d-8ce2-eb1be9fe9ec1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.200933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.201574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.201852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.202125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.202806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:23.203154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.204601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.217694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 350/701] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:23.218719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.268508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.281704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:23.330163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:23.365848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315550b-c93c-4819-8199-87de46fcf754 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.385764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc411f7-e346-4688-a24f-a39a3d646e2e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.412885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.414277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.414565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.414838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.429426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.430840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.430986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.431514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.431792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.432061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] PATH_INFO: `/v3/services/network` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.432899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.434467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-77aced74-f358-4dfe-adb2-0329f3da7e92 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:23.447278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:23.448321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:23.449204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:23.451110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:23.453125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:23.456052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:23.456052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:23.456052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:23.456463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 351/703] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:23.456463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183f0-073e-41c6-8735-208f3b69a6db None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.456463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183f0-073e-41c6-8735-208f3b69a6db None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.456463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183f0-073e-41c6-8735-208f3b69a6db None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.456999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 352/704] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:23.457138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.457352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 352/704] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:23.461660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036183f0-073e-41c6-8735-208f3b69a6db None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.588106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:23.590927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036183f0-073e-41c6-8735-208f3b69a6db None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.598041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42439a5e-80e1-4b48-971f-60c73f037c29 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.614231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:23.635830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.636708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.636896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.637312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.637447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.637617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.637893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.638185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.638520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] RBAC: Adding query filter params (name=network) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:23.638863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.639279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:23.639740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.640216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4500298-6441-4fb6-b38f-dc3bf879fe9d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.641564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.649615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 353/705] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:23.650899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67432110-b4d8-422e-b013-80901c42406a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.651182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67432110-b4d8-422e-b013-80901c42406a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.651459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67432110-b4d8-422e-b013-80901c42406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.661536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 353/706] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:23.662708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.671954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-67432110-b4d8-422e-b013-80901c42406a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:23.673182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-67432110-b4d8-422e-b013-80901c42406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:23.765802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 354/707] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:23.766687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67432110-b4d8-422e-b013-80901c42406a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:23.781397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae929-a322-4c26-b9de-05c2b53f84d9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.822496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.823502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.824022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.824494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.825332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:23.825861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.827509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.835070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 354/708] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:23.903084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67432110-b4d8-422e-b013-80901c42406a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:23.917698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:23.944880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:23.945564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:23.945844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:23.946113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:23.954386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:23.956064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:23.974881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:23.975934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:23.976853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:23.980777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 355/709] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:23.982649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.017634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:24.110092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.129677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aebe62-3545-4fd4-ae7f-a3ee870a3f03 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.180649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.181345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.181651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.182300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.183317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:24.183622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.185201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.218652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 355/710] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:24.224163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.287784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399105-f14d-4832-86f5-31d64d7ac902 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.316845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:24.331630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.332387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.332739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.333083 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.333784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.335214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:24.345547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:24.346604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:24.347924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 356/711] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:24.351729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238267-b190-4e81-aee9-63187131ba94 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.354022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.423977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:24.429425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.430305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.430783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.431563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.505881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a62da7-7b0b-4fe3-a50e-bd57670e05c7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.527567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.529902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceba7d-b8e7-4834-9e93-2483d82b1cf6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.551542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.552334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.552948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.553328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.554504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:24.554922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.556383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d502f-4c14-405e-8d59-444edfea95af None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.563202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 357/712] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:24.565506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4671e-1c05-4424-80dd-68e5b3f1b59b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.565900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4671e-1c05-4424-80dd-68e5b3f1b59b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.566719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4671e-1c05-4424-80dd-68e5b3f1b59b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.572346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 358/713] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:24.572346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4671e-1c05-4424-80dd-68e5b3f1b59b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.626124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:24.652202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 356/714] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:47:24.653626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5d3d-17d6-409a-b8d5-5534114b7a70 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.654017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5d3d-17d6-409a-b8d5-5534114b7a70 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.654393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5d3d-17d6-409a-b8d5-5534114b7a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.674051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-117e5d3d-17d6-409a-b8d5-5534114b7a70 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:24.675441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-117e5d3d-17d6-409a-b8d5-5534114b7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:24.687659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:24.692705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4671e-1c05-4424-80dd-68e5b3f1b59b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.732093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.733094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.733573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.734045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.734981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:24.735484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.737242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.744057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 359/715] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:24.745118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:24.753525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 357/716] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:24.900872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdfe9-8d78-4dfd-a1c2-29375aa47dd4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:24.910309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f854a7-ad2d-488f-9db8-4aaffa8027f5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.910606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f854a7-ad2d-488f-9db8-4aaffa8027f5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.910873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f854a7-ad2d-488f-9db8-4aaffa8027f5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.912348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 358/717] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:24.917293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.917623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.917907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.937961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:24.939271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:24.944483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:24.945449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:24.945924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:24.946365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:24.958975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:24.960719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:24.977909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:24.978875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:24.979725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:24.979725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:24.979725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:24.982052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 360/718] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:24.990553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.021290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.025265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 359/719] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:47:25.090567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.130842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b17f8-950e-4e2f-94de-f25d29acf155 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.177681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.178301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.179105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.179381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.179649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.180302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:25.180604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.182000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.209431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 361/720] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:25.214247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.244332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e0b7-a126-4cca-8c3c-a8b35b951c0a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.280208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.280883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.281223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.281509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.292756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:25.298396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:25.299919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:25.300761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 360/721] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:25.306391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.357823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.396892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afaed8-b591-4ace-a003-28c30cde6a02 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.459918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.460473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.460748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.461017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.474794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.480346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.490669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.497840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a8dd-dc43-48af-bc6f-83360229f315 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:25.499102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:25.500001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:25.500878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:25.504605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 362/722] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:25.505642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.549553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.550146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.550513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.550876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.551656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:25.552209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.554532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.569564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 361/723] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:25.570649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.638560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b25c1-286a-4c6b-83c2-e2ce6cfe5803 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.683739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420238-cb24-4210-83df-2506f3bf1275 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.684776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.685751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.686294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.686763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.690053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.700190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:25.706762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:25.707718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:25.708533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:25.711451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 363/724] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:25.712692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.726815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.727707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.727707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.728006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.728729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:25.729039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.730498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.744765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 362/725] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:25.745701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.766120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:25.841255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26060b-ff08-4a65-a702-eaa5b058e158 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.857461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15047a3-7ecd-4293-85fe-74b4b92e2d53 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:25.881914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.882984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.883456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.885912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.900857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea271-1505-4181-a557-4630470346cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:25.901477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea271-1505-4181-a557-4630470346cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:25.901845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea271-1505-4181-a557-4630470346cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:25.902061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea271-1505-4181-a557-4630470346cb None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:25.902744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea271-1505-4181-a557-4630470346cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:25.903105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea271-1505-4181-a557-4630470346cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.903431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:25.904585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea271-1505-4181-a557-4630470346cb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.905424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:25.919170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 363/726] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:25.920192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea271-1505-4181-a557-4630470346cb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:25.931108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:25.932092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:25.932961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:25.932961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:25.932961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:25.940258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 364/727] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:25.941369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:25.995251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.013901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.030162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea271-1505-4181-a557-4630470346cb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.061305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d36c38-9d6f-4a9d-91ab-e436331dc787 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.068077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.068684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.068956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.069221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.069992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:26.070646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.072506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.078549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 364/728] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:26.079376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.113924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.114941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.115447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.115919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.130067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.131911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-79337c22-4adf-4fb4-85c4-23ab04dfee5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:26.152797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:26.153826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:26.154722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:26.154722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:26.154722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:26.157032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 365/729] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:26.163640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee5a2-252c-4839-8e80-f49e2342f526 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.164302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee5a2-252c-4839-8e80-f49e2342f526 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.164777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee5a2-252c-4839-8e80-f49e2342f526 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.166723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 366/730] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:26.171914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ee5a2-252c-4839-8e80-f49e2342f526 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.242544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e87da-f48b-40f0-b3ec-3638eb882191 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.289789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.290345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.290740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.291222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.293336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:26.294628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.296636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb42a-5f73-4c56-8f3c-a189b138e8c0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.297769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.309240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ee5a2-252c-4839-8e80-f49e2342f526 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.312247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 365/731] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:26.313800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.315517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.316036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.323606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.336318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:26.338014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:26.350200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.350813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.351089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.351360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.352012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:26.352413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.361935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.367189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 367/732] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:26.368112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.424646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 366/733] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:26.425616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.474156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735c33-5c1b-407c-98a4-e60bbfa51810 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.510432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.511060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.511334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.511604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.519662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.521099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:26.533399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:26.534496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:26.535436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 368/734] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:26.546644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.581156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.611702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518be1b-2c05-408d-96de-ef699c8bbe52 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.650786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.651421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.651693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.651963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.660253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.661855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.665922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:26.677835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:26.678820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:26.679731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:26.680702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 367/735] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:26.686129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.764840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd9257-0ddf-46e9-9427-10adbcfb94c7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.804605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.805180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.805465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.805876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.806625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:26.806933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.808476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.820858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd477-a129-4562-a977-475a6217beb6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.828588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 369/736] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:26.829446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.871169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.871777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.872054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.872321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.873055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:26.873417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.874877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.896436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 368/737] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:26.897325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:26.918920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.941813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8c29-858f-4ed3-a17c-1bad0636042e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:26.956330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:26.975984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:26.976583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.976858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.977127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:26.977792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:26.979138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04610c-166e-4d13-9413-6b9256afa389 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:26.995644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 370/738] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:26 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:26.997629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cfe4b-f212-4104-89f5-cb013bbb648c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:26.998199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cfe4b-f212-4104-89f5-cb013bbb648c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:26.998482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cfe4b-f212-4104-89f5-cb013bbb648c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.000392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 371/739] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:27.001810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cfe4b-f212-4104-89f5-cb013bbb648c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.011588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90560-4913-4b71-8c91-817b7be46790 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.065327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.067029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.067521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.067995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.148747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cfe4b-f212-4104-89f5-cb013bbb648c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.159009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.160502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325ac5-0f9b-4d4f-87c9-717f1f271820 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.204181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f756-089f-470f-8460-71b191889c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.204181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f756-089f-470f-8460-71b191889c18 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.204181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f756-089f-470f-8460-71b191889c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.204181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f756-089f-470f-8460-71b191889c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.218511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.221253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.291122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 369/740] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:26 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:27.292721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.293136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.293812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.297766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204f756-089f-470f-8460-71b191889c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.300157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204f756-089f-470f-8460-71b191889c18 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.316607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:27.318109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:27.390911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 370/741] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:47:27.392792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.411187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 372/742] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:47:27.416183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f756-089f-470f-8460-71b191889c18 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.461423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.478784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.504406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3e0a4-7a03-4310-96e4-fbd409d7e377 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.526097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f756-089f-470f-8460-71b191889c18 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.541252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.542163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.542610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.543034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.555022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.556749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.564480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.565058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.565410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.565767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:27.573302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:27.574257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:27.575154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:27.575154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:27.575154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:27.577202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.577394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 371/743] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:27.583007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.584310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:27.604827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:27.605836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:27.607133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:27.607133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:27.607133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:27.607133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 373/744] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:27.612318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.723713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f28d0-216d-4c53-bb52-beb5500403e9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.747490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.758710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4b9f-ff72-413a-9e4f-a6dc6d2b5a33 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.773529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:27.792100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.792726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.793007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.793313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.794228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:27.794538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.795911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.798226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.799226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.799717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.800178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.801029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:27.801546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.803100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.816374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 374/745] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:27.817523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 372/746] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:27.820560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.821983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.926625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2c377-4520-439d-82da-cc32ea562818 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.935897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346137-3b05-45cf-a66a-b17cf7935469 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:27.962101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.962733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.963005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.963258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.963910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.965246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.978777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:27.979746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:27.980230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:27.980703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:27.989510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 375/747] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:27 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:27.989510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:27.995478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:27.997282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:27.997830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:28.028240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:28.029225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:28.030159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:28.033303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 373/748] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:28.039193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:28.149854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:28.184523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204b88-0f6a-4eb2-9846-0bc668154594 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:28.224384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ed88-53a1-44c7-8cd5-f1654a8a84e8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:28.225429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:28.226090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.226368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.226639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.236535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:28.238146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ab3b3f8d-b74a-4ebe-ba16-c528525d51b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:28.253743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:28.254676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:28.255570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:28.255992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 376/749] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:28.257060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3abb-2473-4a75-8829-7ed94204204e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.257343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3abb-2473-4a75-8829-7ed94204204e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.257800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3abb-2473-4a75-8829-7ed94204204e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.261755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 377/750] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:28.264589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.265018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.265349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.270006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:28.270608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.270883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.271154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.271849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:28.272151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:28.273784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:28.288687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:28.289948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:28.292147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 374/751] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:28.293907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:28.380326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:28.396229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 378/752] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:28.397083 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:28.419340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dae520-182e-4f35-99c8-12c03fe76bcd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:28.432007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:28.461199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:28.461888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.462261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.462685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.463478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:28.463928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:28.465411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:28.478114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 375/753] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:28.484671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:28.536143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed906-9746-407b-8a53-706c810c65c6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:28.576070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:28.576874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.577274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.577699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.578523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=fcdafb2881494434ae9e742a103117bb) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:28.578938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:28.581154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:28.587144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 379/754] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:28 2022] GET /identity/v3/role_assignments?user.id=fcdafb2881494434ae9e742a103117bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:28.622708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab7aa-35e3-4a96-ab40-c418df9648c4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:28.663222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:28.664098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:28.664557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:28.665006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:28.665936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=f2f1d6fdb382403cb9b9d4c60cf582bb) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:28.666397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:28.668004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:28.676003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 376/755] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:28 2022] GET /identity/v3/role_assignments?user.id=f2f1d6fdb382403cb9b9d4c60cf582bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:28.868105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:28.943236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:28.995459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78268a51-d04f-4f1a-b3b2-e93fb4a11fef None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:29.038283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:29.038911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.039193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.039462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.056354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:29.061287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:29.062454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:29.063311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 380/756] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:29.069022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:29.122461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:29.214575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da0da-9e9d-4bba-a695-602d0c63f5e9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:29.259328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:29.259931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.260205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.260475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.261134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:29.261430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:29.262799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c498-cdae-4a45-8a25-5f0aad1ab22d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:29.277254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 377/757] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:29.282344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:29.424060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f02a-2d20-4341-9d5a-ccb9a3665aaa None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:29.450735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:29.466147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:29.466822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.467105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.467378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.477808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:29.479245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:29.489664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3200b-81e2-4e6c-8cf6-c5297d0eaea8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.489948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3200b-81e2-4e6c-8cf6-c5297d0eaea8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.490263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3200b-81e2-4e6c-8cf6-c5297d0eaea8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.491799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 378/758] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:29.495723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:29.496891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:29.498025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:29.498025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:29.498025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:29.498232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.498232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.498232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.500122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 381/759] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:29.506829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:29.531794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:29.533000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:29.666328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 379/760] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:29.681681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed13e-7468-4539-9b0d-27401ad042e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:29.719224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:29.719836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.720635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.720911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.721586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:29.721891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:29.723250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:29.736623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 382/761] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:29.742236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:29.776676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:29.872493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc576e-a3db-4b1c-b7a6-786fe68c9457 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:29.911752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:29.912405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:29.912686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:29.912957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:29.926142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:29.927607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:29.942723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:29.943704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:29.944621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 380/762] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:29.949534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:29.991895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.005399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.126898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.132880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e0959-efeb-47b1-8665-8fcfa82b02cc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.152156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f9b9e-584e-4d05-972a-30dea63a6e0b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.169292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.169933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.170209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.170579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.171308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:30.171609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.173749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.193551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:30.202431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.238794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.239436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.239722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.240001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.240598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.242000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:30.266501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:30.268297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:30.269214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:30.271575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 381/764] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:29 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:30.277039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.365338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.384339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058a2-94fb-432c-a61b-a996cd8b27e7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.389922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef28c7-ca89-4201-975a-d4326e654ee6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.434794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.435608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.435888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.436151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.439868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.440738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.441228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.441818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.442658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] RBAC: Adding query filter params (name=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:30.443263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.445052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.450884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 382/765] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:30.456022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.458069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.461963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:30.493475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:30.494479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:30.495431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:30.495431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:30.495431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:30.496893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.504654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 384/766] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:30.527041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.707583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b130fe-f33f-4d9e-8578-c7fd8d030740 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.713275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc6d87-c490-4920-ad20-9e4b42dc1a49 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.754300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.755279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.755774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.756266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.757107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:30.757636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.759606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.774648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 385/767] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:30.780316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.785563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.800994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.801979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.802500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.802987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.803824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] RBAC: Adding query filter params (type=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:30.804333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.805927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e680-921c-4d2e-bf9d-7efd23b43543 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.811489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 383/768] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:30.817923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe32-0a0b-4c03-a382-9736bd9296ac None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.818450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe32-0a0b-4c03-a382-9736bd9296ac None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.818979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe32-0a0b-4c03-a382-9736bd9296ac None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.820836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 384/769] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:30.822497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbfe32-0a0b-4c03-a382-9736bd9296ac None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:30.900942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188498-e3c6-4a51-970b-ac0abffca692 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.917045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:30.939979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.940610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.940889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.941162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.942031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbfe32-0a0b-4c03-a382-9736bd9296ac None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:30.948410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.949966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-bf2dc851-d26a-40e7-b108-414162e76dbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:30.962042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:30.962969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:30.963854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 386/770] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:30.964907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185037a-676e-42cb-b70e-357dabc69c36 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.964907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185037a-676e-42cb-b70e-357dabc69c36 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.965165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185037a-676e-42cb-b70e-357dabc69c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.983947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a185037a-676e-42cb-b70e-357dabc69c36 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:30.984141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:30.984730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.985008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.985106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a185037a-676e-42cb-b70e-357dabc69c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:30.985274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.986546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] RBAC: Adding query filter params (interface=public, service_id=a40a7cc3270e48aaab8fa6c0c90391d2, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:30.986909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:30.988283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19599-6183-4347-8a14-31926c0d38ec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:30.995817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 385/771] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/endpoints?service_id=a40a7cc3270e48aaab8fa6c0c90391d2&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:30.996995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b86-0690-4993-a0cd-0f3d7c24d9b0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:30.997284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b86-0690-4993-a0cd-0f3d7c24d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:30.997588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b86-0690-4993-a0cd-0f3d7c24d9b0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:30.998876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 386/772] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:30.999446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b86-0690-4993-a0cd-0f3d7c24d9b0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.046874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.058326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 387/773] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:31.059709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4a2a-a3ad-4bbd-9cd7-4628681923da None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.059997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4a2a-a3ad-4bbd-9cd7-4628681923da None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.060268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b4a2a-a3ad-4bbd-9cd7-4628681923da None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.061513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 388/774] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:31.062191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b4a2a-a3ad-4bbd-9cd7-4628681923da None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.112040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b86-0690-4993-a0cd-0f3d7c24d9b0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.148035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.148643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.148922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.149191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.149919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:31.150245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.151667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c1d25-ebb5-4d6d-b130-b59b392c5ebc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:31.169225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 387/775] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:31.169225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.169225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.169225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.172807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.185157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:31.186394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:31.192828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b4a2a-a3ad-4bbd-9cd7-4628681923da None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.228879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.229406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.229712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.229983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.230600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.231942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9090f14-1494-47ee-8b9f-0d3a48fe0234 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:31.238298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 389/776] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:31.239769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6c24-ae56-4601-b253-458561181d9b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.240206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6c24-ae56-4601-b253-458561181d9b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.240486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6c24-ae56-4601-b253-458561181d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.261194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 388/777] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:31.262735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.283126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-802b6c24-ae56-4601-b253-458561181d9b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:31.286409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-802b6c24-ae56-4601-b253-458561181d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:31.372366 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.392985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 390/778] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:31.394126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6c24-ae56-4601-b253-458561181d9b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.451786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975296-6881-45b0-b4d0-ae593d31f373 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.503836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6c24-ae56-4601-b253-458561181d9b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.526480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.538811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.539580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.539861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.540134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.540786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.541676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.542161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.542693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.543732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.545370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:31.546856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=e4e7f0ac2d354e1eac91ab2b91e5a89b, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.548839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:31.556097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:31.557084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:31.557950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:31.560645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 391/779] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:31.566823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.587061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 389/780] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:31 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:31.588327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.628693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.691852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fd55-d170-4a8e-9539-4cbd34f290d6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.745431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.746161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.746809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.747094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.756410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1619c-c29f-4c41-aafe-36d77bbf02e5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.762521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:31.769685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:31.770666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:31.771761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 392/781] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:31.772605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.797729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.799771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.800058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.800338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.800983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:31.801396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.802975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:31.809037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 390/782] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:31.810026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.887054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.898320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0407bb3-9ffd-4182-9208-c6a6c859947d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.911404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:31.934782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598b25-9d52-459a-9877-fc9737c970c1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:31.944589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.945228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.945531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.946285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.965002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:31.970561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:31.971464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:31.972273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:31.976191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 393/783] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:31.976191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:31.982806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:31.983577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:31.983951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:31.984315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:31.985085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:31.985555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:31.990500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.005518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 391/784] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.007531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.097089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b0eb-4065-4442-926f-71b9d7853713 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.116472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3f86-66a5-4ba6-9862-209da350f66f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.138396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.139006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.139520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.139776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.140576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.141632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:32.143147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.144741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.151058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 394/785] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.152307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.163126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.163738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.164003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.164175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.164832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:32.165138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.167222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.181625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 392/786] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.181625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.209844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.305876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc6e31-c018-46e1-ad29-1398932b68ee None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.308444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02afa-845e-44a2-a3f4-ee9971b2c6d7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.349348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.350250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.350902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.351337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.352286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] RBAC: Adding query filter params (interface=public, service_id=80202aca6f5a43f1a267b824588475a1, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:32.352596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.354087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.355610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.356394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.357095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.357381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.360652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 393/787] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/endpoints?service_id=80202aca6f5a43f1a267b824588475a1&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.361606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.375798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.378665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:32.398879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:32.400077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:32.401065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:32.401065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:32.401065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:32.401065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 395/788] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:32.401285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.423778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.497723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb1ee-30c7-4ae7-9183-e62ea788f32c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.517346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.538107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697ad0c-6b11-43c9-b8d7-4eb44e2d7ff5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.541215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.542254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.542870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.543334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.557568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.559517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.576931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.577617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.577900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:32.578114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:32.579083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:32.580549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:32.580549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:32.580549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:32.580729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.580729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.581155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.583449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 394/789] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:32.584702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.589563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 396/790] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.590652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.751737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053112-72c2-4b61-bf9e-e41857fe38c9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.787365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.787969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.788248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.788524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.789169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:32.789467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.790852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.809003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 397/791] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.810301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.811055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.818177 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef146bf-52a3-479b-84ed-9c5e538d8e7e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.822759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:32.860705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.862179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.862662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.863143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.864163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:32.864630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.867047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.884505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 395/792] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:32.890574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:32.921393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592626b-85c7-46c5-bd3b-e4c2fbff8c2b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:32.959314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:32.959947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:32.960232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:32.960502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:32.968128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:32.970169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:32.983545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:32.984611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:32.987750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:32.992089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 398/793] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:32.992089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.068435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.119870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dad24-92b4-4272-9d9c-96e37d723b84 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.161260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707539-05c8-4802-8a85-88a8789060f3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.185299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.185929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.186198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.186463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.187190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:33.187494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.189078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.215089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 399/794] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:33.216553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.237175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.237955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.238240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.238517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.254241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.255815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:33.275201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:33.276229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:33.277203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 396/795] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:33.284265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.322007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438629-bfdf-4e23-9e00-64be26ad6aea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.324049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.353098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.359537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.360316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.361372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.361685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.373668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.375127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:33.392343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:33.394111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:33.395474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:33.395474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:33.395474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:33.401567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 400/796] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:33.402453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.476326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4623-46a5-4a81-918a-904af9f06344 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.521442 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ca99-5bfe-4af9-a3a3-080d7c77703b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.527331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.528268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.529220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.529747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.531132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:33.531654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.534559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9a8f6-cceb-4ad5-99f5-b6ed5ee9a06c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.559292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 397/797] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:33.560900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596a95-0c51-4909-817d-8fa6da7da27a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.561400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596a95-0c51-4909-817d-8fa6da7da27a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.561904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596a95-0c51-4909-817d-8fa6da7da27a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.563936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 398/798] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:33.564132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.564751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.565043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.565311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.565708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596a95-0c51-4909-817d-8fa6da7da27a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.566000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:33.566305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.567667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913335e-34b6-4c70-81d8-f9a5cd2d3dcc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.590636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 401/799] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:33.590636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3595-671e-49fa-8777-122017069828 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.590636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3595-671e-49fa-8777-122017069828 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.590636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3595-671e-49fa-8777-122017069828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.607788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9a0c3595-671e-49fa-8777-122017069828 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:33.609112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9a0c3595-671e-49fa-8777-122017069828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:33.656575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.660543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.692843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596a95-0c51-4909-817d-8fa6da7da27a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.705465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 402/800] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:33.706939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3595-671e-49fa-8777-122017069828 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.764527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.765199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.765494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.765773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.790212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.791681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:33.819779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:33.820784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:33.821679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:33.821679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:33.821679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:33.824041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3595-671e-49fa-8777-122017069828 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.829947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 399/801] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:33.830913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:33.867137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:33.868257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.868730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.869396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.879513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:33.882101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8840f0b9-69f5-41c8-aa4f-f84805c46ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:33.897409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:33.898477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:33.899567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:33.901221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 403/802] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:33.903256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775317-2dfd-4d5f-9df3-8f60980e168a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.903824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775317-2dfd-4d5f-9df3-8f60980e168a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.904241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775317-2dfd-4d5f-9df3-8f60980e168a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.906675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 404/803] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:33.912365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:33.912647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:33.912915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:33.937058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:33.939512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:33.963406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65360-d36a-49bf-80c2-4eaf99b77896 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:33.972093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:33.993273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.003289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.004190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.004719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.005153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.006008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:34.006501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.008116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.021776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 400/804] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:34.022783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.025538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 405/805] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:34.026877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.150928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fb56b-785e-4257-8db8-de778ddcd857 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.152072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01652-63cc-4bb5-a3ed-8440f4a77d98 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.191815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.192018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.192554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.192835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.193107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.193543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.194160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.194620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.195796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:34.196671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.198326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.200627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.202097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.212856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 401/806] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:34.214061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:34.220848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:34.221767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:34.222636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:34.226979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 406/807] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:34.227900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.253067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.277884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.343066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0472-4b44-48bb-8c1b-eff83e8f9f70 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.343776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e8d3-27c6-4b28-9377-603ff8757d0e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.379026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.379742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.380024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.380305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/fcdafb2881494434ae9e742a103117bb/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.382121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.382845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.383216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.383591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.384269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.385768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:34.394741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:34.395938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:47:34.396972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:34.397947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=fcdafb2881494434ae9e742a103117bb, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.397947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.398428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 402/808] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:34.398818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.421687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 407/809] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:34 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/fcdafb2881494434ae9e742a103117bb/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:34.423738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.511772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.515267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d696c-3382-4bec-8cd1-8943ad59b8e9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.528275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.553631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ee98-8ff3-4ea3-8ecd-51ec66539ab5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.555633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.556447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.556811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.557997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.557997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:34.558442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.559979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.574529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 403/810] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:34.575556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.598225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.599174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.599459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.599730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.612894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:34.617795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:34.618914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 408/811] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:34.619938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.715743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a57a-c5e0-49df-ab03-76b44bad8165 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.750741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f140-2a4e-4695-8263-6ac0992ebfd5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.766059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.767400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.767981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.768677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.769476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] RBAC: Adding query filter params (name=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:34.770300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.772307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.784486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 404/812] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:34.784486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.790381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.800317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.801254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.801567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.801852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/f2f1d6fdb382403cb9b9d4c60cf582bb/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.803817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=f2f1d6fdb382403cb9b9d4c60cf582bb, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.805385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.819883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 409/813] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:34 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/f2f1d6fdb382403cb9b9d4c60cf582bb/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:34.820546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:34.841881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:34.917955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292bb8f-28d4-40e0-a880-150bdfbccf90 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.957408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:34.958160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.958517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.958858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.959649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:34.960058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:34.961576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287678d2-412d-46a1-b6a4-f0888232aa6b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:34.964764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8bf0-b104-4603-acc9-842a724e0571 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:34.975515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 405/814] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:34.976902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f64d7-3393-4c67-95b3-f076916b6ad8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:34.977253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f64d7-3393-4c67-95b3-f076916b6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:34.977622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f64d7-3393-4c67-95b3-f076916b6ad8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:34.979079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 406/815] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:34.981166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f64d7-3393-4c67-95b3-f076916b6ad8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.020817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.021585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.021982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.022326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.023034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:35.023408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.024843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fe3d-0dc2-4343-a17e-493accb4a6f0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.030696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 410/816] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:35.031988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.037440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.037858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.058151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:35.059668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:35.100218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.110141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f64d7-3393-4c67-95b3-f076916b6ad8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.134100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.147361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.148044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.148407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.148646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.156781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 411/817] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:35.158586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.169045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.170585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:35.198283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:35.199310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:35.200184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:35.200184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:35.200184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:35.210011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 407/818] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:35.211909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.279419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efdcbc-af25-43a0-954d-68b672ee2f73 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.317832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.319281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.319797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.320278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.321152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.322777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.358292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 412/819] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:35 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:35.424490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bef4-92ab-40c3-b430-26a05074e2f2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.481940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.482552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.482828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.483101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.483734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:35.484039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.485444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.503964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 408/820] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:35.509109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.554046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.557921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.576677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.666592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a03fe-9376-4559-8cba-10b6c8e94104 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.695843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22898a9a-9533-4104-95bd-76de6bc78f66 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.718240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.718881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.719160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.719431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.728115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.729593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.743351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.744140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.744514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.744898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.745619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:35.746009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:35.747089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:35.748236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 413/821] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:35.749076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.754840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:35.762759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:35.763738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:47:35.764575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:35.768907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 409/822] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:35.770239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.856626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.882766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:35.886414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe5f5-c264-4c5d-a33b-42729e881aec None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.908728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5397-8761-41ef-842d-28f29df618b3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:35.925962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.926884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.927362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.927884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.928868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:35.929392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.931093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.955662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 414/823] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:35.956963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:35.958584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:35.959203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:35.959482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:35.959757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:35.960397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:35.960702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:35.963442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:35.973568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 410/824] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:35.976557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.091043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5efedd-e0aa-41c2-a12f-7b01910f6558 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.111548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed91b7b-ff97-44a2-8aa5-ccb79373abec None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.135210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:36.143481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.144503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.144791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.145068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.145997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:36.146307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.147798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.150248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.151082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.151550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.152012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.158382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 411/825] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:36.161194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.186210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:36.230940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.232707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a31ea-5c6e-4fda-b1c9-368dde104a13 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.269789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fc4e-f278-4681-bfeb-920ff957fca2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.305470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.306102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.306381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.306655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.307328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.308689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.337529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 412/826] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:36.352954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 415/827] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:47:36.354496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.421902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:36.483137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2efbdb-717b-4a1a-b210-fd05e93931fc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.521266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.521935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.522213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.522485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.533828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.535276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.540011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556edff-45de-4f0d-8cf9-b31c200b5627 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.540479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556edff-45de-4f0d-8cf9-b31c200b5627 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.540572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556edff-45de-4f0d-8cf9-b31c200b5627 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.542034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 416/828] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:36.547676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.548157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.548784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:36.552088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:36.552991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:36.554332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:36.554332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:36.554332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:36.554332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 413/829] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:36.559334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.574594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:36.575739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:36.644270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:36.663552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 417/830] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:36.669100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:36.673014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa73981-8102-49b1-ac79-24884e38c7cb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.718395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.719006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.719286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.719555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.720967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:36.721430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.722832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.735184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 414/831] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:36.741436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.842685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a167-aef7-4bf3-bd69-6c9e770c4f9a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:36.878612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:36.879602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.880095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.880555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.887858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:36.889552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-aacff46f-1ac2-45c2-9796-8c6c9fe83991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:36.902408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:36.903309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:36.904174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:36.911605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 418/832] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:36.914569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:36.929915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8228-fe2a-4e03-8c2e-d78b4a1fcb77 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.930192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8228-fe2a-4e03-8c2e-d78b4a1fcb77 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.930398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8228-fe2a-4e03-8c2e-d78b4a1fcb77 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.931967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 419/833] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:36.936720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:36.937003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:36.937279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:36.956390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:36.957642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:37.002705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.034409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6909ef-3990-44a6-80f9-7b5235f5924e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.048034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 420/834] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:37.049285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.075055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.076329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.076740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.077098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.078241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:37.078620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.081377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.101667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 415/835] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:37.105243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.135141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.185696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338df3f6-67b9-4f2a-bed9-9a02b6aa7f85 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.218718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4b10-f3b7-4aa5-95f6-128fe37c7388 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.230441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.231699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.232427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.232907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.247690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:37.253477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:37.254407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:37.255248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 421/836] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:37.261546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.262066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.262496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.262943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.263357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.264228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:37.264713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.267891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.281991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 416/837] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:37.321096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.332907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.409836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c253e4-cd34-4d0a-8ba8-5981bd1fec10 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.450715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.451258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.451523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.451840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.452512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:37.452808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.454226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.456454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.463551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 422/838] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:37.469082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.472396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7bd8b-cf07-48dc-8f79-526845d81752 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.517912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.518824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.519107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.519385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.536406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:37.542858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:37.544050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:37.544896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 417/839] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:37.552683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.617742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.623111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116073f7-2248-4c20-9351-a1ad176cd403 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.669369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a232-fb93-48b0-97dc-618012c1de1d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.671207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.671935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.672303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.674033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.685057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.686699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:37.702322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:37.703478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:37.704697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:37.704697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:37.704697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:37.710790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 423/840] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:37.711794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.715094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.716692 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.717149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.717695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.718529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:37.718980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.720594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.732116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 418/841] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:37.738497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:37.752768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:37.848566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f34c7e-d6a4-47bd-b1d5-ecd4a75ae40f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.875762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372075fb-1b7b-42e6-a3ff-83a8bdafcbf8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:37.888743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.889356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.889774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.890061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.890720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:37.891324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.893419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.918796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:37.919813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:37.920288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:37.920777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:37.934443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:37.936324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:37.955077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:37.956050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:37.956920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:37.956920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:37.956920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:37.964003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 419/842] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:37.965322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.028499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 424/843] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:38.034087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.035368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.052769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.095374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404339-ebe9-428d-a9ec-1c8f611c0adb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.141296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.143237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.143663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.144050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.144697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:38.145233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.147179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.155548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba60a0-c2f6-449d-803d-b1b1d9d00de9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.162472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 420/844] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:38.167966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.195382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.196161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.196548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.196891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.205229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.206771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:38.218879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:38.221686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:38.224030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:38.229530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 425/845] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:38.231050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.273666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a175-9787-4cbd-a558-23258a33502b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.312863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.352468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617d19-77d7-4e18-899f-35fbe500898b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.393928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.394857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.395295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.395716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.396611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:38.397067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.398745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.411490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.425526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 426/846] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:38.426644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.429985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.430618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.430891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.431219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.438671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.440397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d0ba447e-968b-4e17-b6f1-5ec600165f35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:38.452652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:38.454586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:47:38.456897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:38.459536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 421/847] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:38.460142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf726cd6-ea94-4e76-9e4e-d9899a6ba502 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.460418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf726cd6-ea94-4e76-9e4e-d9899a6ba502 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.460679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf726cd6-ea94-4e76-9e4e-d9899a6ba502 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.465956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 422/848] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:38.465956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf726cd6-ea94-4e76-9e4e-d9899a6ba502 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.540239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a8-b7f6-4ed4-8fcf-dedfb673ab08 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.569581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.574915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf726cd6-ea94-4e76-9e4e-d9899a6ba502 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.576107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.576703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.576977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.577247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.610613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.611221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.611496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.611767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.612492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:38.612795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.614252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814bac-f343-40ec-acb7-676036d5d031 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.631282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 423/849] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:38.632518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.632800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.633067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.650986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:38.652151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:38.666206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.667759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.684637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.724342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 424/850] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:38.725470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.795431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 427/851] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:47:38.802195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:38.839591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.852576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d083de-a86c-47fd-a8f3-49b47b8a9436 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.899627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.900255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.900532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.900804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.925024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807881dc-802b-4c8b-8b49-e5dc41144c12 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:38.947297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:38.962378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:38.963340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:38.963811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:38.964272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:38.976242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.977990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:38.993197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:38.993772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:38.994678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:38.995560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:38.995560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:38.995560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:38.995738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.001841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 428/852] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:39.003389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.101530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 425/853] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:47:39.101750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.108513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.129010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ecbb-33d8-4748-ba35-628627326945 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.165540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.166146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.166421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.166688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.167423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:39.167747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.169355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.173912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.183039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 429/854] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:39.183873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.216805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c677251-6e7d-4100-a4fa-6050b976f9e7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.254462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.255010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.255280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.255549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.256127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.257468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:39.266238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:39.267976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:39.269435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 426/855] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:39.270479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.297664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f7ed-4063-476d-9327-4cf732429db8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.334122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.334742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.335015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.335281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.345422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.346873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.348579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:39.363919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:39.364875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:39.365784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:39.365784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:39.365784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:39.365784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 430/856] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:39.365784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.376482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c432b2-d5b7-47d5-821f-29646c9bd7d7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.404155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.410354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.410976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.411252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.411526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.418064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.419741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e8961a06-6b35-4b04-82d3-932c9a75ad4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:39.430867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:39.431924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:39.433186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 427/857] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:39.434662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185ae1-ef87-4b76-89c6-73674b7db4eb None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.434941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185ae1-ef87-4b76-89c6-73674b7db4eb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.435208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185ae1-ef87-4b76-89c6-73674b7db4eb None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.436449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 428/858] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:39.437123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185ae1-ef87-4b76-89c6-73674b7db4eb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.471805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98480e-59a2-4b62-9202-308481eb6b7a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.505678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.506199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.506474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.506743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.507362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:39.507666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.509004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.513719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 431/859] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:39.514815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.538253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185ae1-ef87-4b76-89c6-73674b7db4eb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.571979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.572571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.572848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.573118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.573805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:39.574074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.574180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.575558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6858ff-6c7b-47b5-af23-04c8e44d82bd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.588248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 429/860] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:39.589211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.589505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.589792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.607219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:39.608388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:39.616800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76e925-4bc6-4d8e-b84c-9ffaf7b695e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.652220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.652818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.653095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.653368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.654088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:39.654399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.654786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.655841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.669003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 432/861] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:39.669906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.676827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 430/862] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:39.677691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.773812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f171-e157-4040-b3b3-c2310f0e10ef None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.777000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f2d22-059d-4514-b801-7bd8961ff00a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.791210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.811180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.811778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.812087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.812312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.812982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:39.813260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.815208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:39.815322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.815837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:39.816115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:39.816498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:39.819991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 433/863] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:39.820591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.830839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:39.832307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:39.851944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:39.852919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:39.853846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:39.855196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 431/864] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:39.860754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:39.908291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:39.967179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82fb8-8ff8-4e28-9429-f840b1ea57ae None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:39.979902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b8510-e75c-47d2-b3be-b39532d41e3f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:40.005301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.005957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.006240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.006514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.007243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=fcdafb2881494434ae9e742a103117bb) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:40.007553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.008969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.015661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 434/865] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/role_assignments?user.id=fcdafb2881494434ae9e742a103117bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:40.017134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:40.032947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.033508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.033831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.034105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.034822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:40.035180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.037447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.052540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 432/866] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:40.058217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:40.085976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:40.174271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3b80-568b-40f3-8b09-8f88b8b0de95 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:40.186787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:40.190181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1836-cba8-453d-ba6b-637cd2dafe53 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:40.223642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.224282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.224834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.225111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.225874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.227539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.232217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.232833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.233114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.233382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.234158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=f2f1d6fdb382403cb9b9d4c60cf582bb) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:40.234465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.236514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:40.238812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:40.239741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:40.240613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:40.242213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 435/867] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 12:47:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:40.246387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:40.248146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 433/868] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:40 2022] GET /identity/v3/role_assignments?user.id=f2f1d6fdb382403cb9b9d4c60cf582bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:40.367674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d31f6-a316-4dbf-914b-75e65c8ff7b3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:40.380522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:40.407601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.408207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.408482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.408752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.409387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:40.409713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.411068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466678cf-ff25-42ac-92d0-77a3288d0aeb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.415760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 436/869] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:40.421582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:40.525511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f0c2-7d7e-46a3-8eb6-6de710645e3a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:40.560543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:40.561145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:40.561420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:40.561718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:40.562352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:40.562648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:40.564125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefb297-ebb6-4faa-9525-85c59a54b2f9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:40.568883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 434/870] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:41.780754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0163-f8c7-47aa-9f20-84d5d0315b64 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:41.781308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0163-f8c7-47aa-9f20-84d5d0315b64 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:41.781308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0163-f8c7-47aa-9f20-84d5d0315b64 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:41.783495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 437/871] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:41.788900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f76c-53b3-4602-8961-afd98a6d74c7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:41.789310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f76c-53b3-4602-8961-afd98a6d74c7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:41.789529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f76c-53b3-4602-8961-afd98a6d74c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:41.808840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8223f76c-53b3-4602-8961-afd98a6d74c7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:41.810026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8223f76c-53b3-4602-8961-afd98a6d74c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:41.834709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:41.880773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 435/872] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:42.148907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b0163-f8c7-47aa-9f20-84d5d0315b64 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:42.169063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeab88-251b-4ea7-ac7b-55784e52f799 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.169351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeab88-251b-4ea7-ac7b-55784e52f799 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.169677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeab88-251b-4ea7-ac7b-55784e52f799 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.171266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 436/873] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:42.177025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8a88-8030-444d-a97b-bd1b0d19fdf9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.177290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8a88-8030-444d-a97b-bd1b0d19fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.177599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f8a88-8030-444d-a97b-bd1b0d19fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.196520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ca7f8a88-8030-444d-a97b-bd1b0d19fdf9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:42.197741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ca7f8a88-8030-444d-a97b-bd1b0d19fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:42.266835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b0163-f8c7-47aa-9f20-84d5d0315b64 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:42.272426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 437/874] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:42.291133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc41c-3c78-4e66-ac7f-43ffc0a52d24 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.291645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc41c-3c78-4e66-ac7f-43ffc0a52d24 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.292067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc41c-3c78-4e66-ac7f-43ffc0a52d24 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.295172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 438/875] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:42.300288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c960c8-8204-450e-bf33-f9cfaa2336cb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.300739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c960c8-8204-450e-bf33-f9cfaa2336cb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.301148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c960c8-8204-450e-bf33-f9cfaa2336cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.303923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:42.304831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.305218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.305613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.306368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:42.307800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6f05f-c6eb-473d-a55d-958953f7ef21 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:42.322300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-09c960c8-8204-450e-bf33-f9cfaa2336cb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:42.323784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-09c960c8-8204-450e-bf33-f9cfaa2336cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:42.337513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 438/876] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:42 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:42.418957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 439/877] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:42.526190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abf31-1d95-4a5a-9a65-d74edb2b7e05 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.526529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abf31-1d95-4a5a-9a65-d74edb2b7e05 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.526742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6abf31-1d95-4a5a-9a65-d74edb2b7e05 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.528186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 439/878] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:42.533376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.533934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.534416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.550596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6abf31-1d95-4a5a-9a65-d74edb2b7e05 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:42.553679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:42.555042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:42.566125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:42.593704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:42.634714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 440/879] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:42.674359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6abf31-1d95-4a5a-9a65-d74edb2b7e05 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:42.693750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:42.719885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:42.720705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.721025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.721328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.739099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:42.745803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:42.746732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:42.747555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:42.750520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 440/880] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:47:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:42.757221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:42.825054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491b5b-aaa1-4baf-a3d4-bdf297e99583 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:42.869422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c60135-b261-450f-a803-a945ab957350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:42.870184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c60135-b261-450f-a803-a945ab957350 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.870466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c60135-b261-450f-a803-a945ab957350 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.870739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c60135-b261-450f-a803-a945ab957350 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.871328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c60135-b261-450f-a803-a945ab957350 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:42.873234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c60135-b261-450f-a803-a945ab957350 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:42.881701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfa31d-d11f-41f5-b385-8a35daff251c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-72c60135-b261-450f-a803-a945ab957350 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:42.884192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:42.885206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:42.890699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 441/881] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:42.893874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:42.894811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c60135-b261-450f-a803-a945ab957350 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:42.909110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:42.928867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:42.929740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:42.930015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:42.930284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:42.930999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:42.931249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:42.932597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:42.940957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 441/882] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:47:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:42.941759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.014696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c60135-b261-450f-a803-a945ab957350 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.046024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adecc2f-818a-448d-8496-4c3ace8244e4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.050353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.050966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.051245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.051517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.052147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:43.052448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.053833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.058451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 442/883] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:43.059059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.087616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.088239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.088520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.088796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.089457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.093067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.116913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 442/884] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:42 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:43.116913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.143434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:43.155837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:43.198725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eb2a-9978-4434-b894-be2e040d8b0a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.257566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.257780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347d795-2a0e-4be3-9279-21acae696140 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.258544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.259044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.259320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.275490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.276933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:43.294945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:43.295943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:43.296830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:43.296830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:43.296830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:43.296830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 443/885] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:43.303757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.304566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.305299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.305683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.306068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.306977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:43.307296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.309590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.315412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 443/886] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:43.425233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985d3c-8339-4b58-9d64-136e73ee3914 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.449958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:43.466455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.467108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.467486 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.467657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.468347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:43.468657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.471068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.484582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 444/887] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:43.491443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.587617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:43.598047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb55f5-e769-43c8-9712-2f5e5a365a18 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.633600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.634235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.634518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.634791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.644062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.645520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:43.657504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:43.658544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:43.659478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:43.661573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 444/888] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:43.664738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.775152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e709a5-a424-4e87-95cf-791a67527c65 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.815135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.815747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.816024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.816302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.817041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:43.817344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:43.818803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:43.837275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 445/889] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:43.842726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:43.951078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87f34-b295-4a4c-b251-6bac5476f69b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:43.987629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:43.988235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:43.988511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:43.988778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:43.999682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:44.066029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.067450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ee744-7387-42c6-9d5b-005c7775da0b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.183950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 445/890] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:47:44.185431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.226528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:44.290358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9af97-e256-4483-ae41-e6ce3877ffc7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:44.330839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:44.331406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.331682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.331954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.343605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.345655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.356602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c575a4-29ae-45a9-9c52-9820906c7209 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.356915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c575a4-29ae-45a9-9c52-9820906c7209 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.357166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c575a4-29ae-45a9-9c52-9820906c7209 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.358876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 446/891] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:44.362465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:44.363409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:44.364509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:44.364509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:44.364509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:44.364509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 446/892] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:44.365678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.365965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.366241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.374514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.390480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:44.392631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:44.437860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:44.472852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 447/893] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:44.475263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:44.489442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991a8e-8f79-441e-9723-24283c4c451d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:44.525280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:44.525906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.526186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.526456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.527095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:44.527394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.528747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.542812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 447/894] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:44.550762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.654014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70860-2daa-4a1f-9076-5a2b68d8ee4b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:44.690946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:44.691575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.691856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.692131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.698929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.700413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:44.712233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:44.714361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:44.716455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:44.721157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 448/895] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:44.721348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.748553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.787850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:44.863299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c6cf-b592-4c79-adfd-aa2575403601 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:44.879184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3593c-b580-48e9-8cd8-695216f1691d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:44.905718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:44.906252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.907402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.907683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.908517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:44.908986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.911078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.925460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 448/896] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:44.930606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:44.931251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:44.931531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:44.931806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:44.932399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:44.934038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:44.934816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:44.944680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:44.946749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:44.947924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 449/897] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:44.953098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:44.953738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.073068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332671-d1ac-4f03-a324-1cd43a89620d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.075144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.088461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e2f5-1c4d-4b35-8f50-ed3b685b9984 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.128493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.129927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.130490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.130914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.132057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] RBAC: Adding query filter params (role.id=04c305da2ad7457cb733d92d4706c785, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=fcdafb2881494434ae9e742a103117bb) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:45.132914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.134808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.137572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.138705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.139086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.139465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.140417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:45.140786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.142237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 449/898] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/role_assignments?user.id=fcdafb2881494434ae9e742a103117bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=04c305da2ad7457cb733d92d4706c785 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:45.142369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238444a-3cbf-4bdb-b630-e2c54598bc03 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.156042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 450/899] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:45.161836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.210902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2b3a-f338-4dda-9587-ed6356d5f13b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.211555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2b3a-f338-4dda-9587-ed6356d5f13b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.212090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2b3a-f338-4dda-9587-ed6356d5f13b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.214177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 451/900] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:45.222852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa00c5-d126-4630-ba28-ec4fa875ade8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.223693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa00c5-d126-4630-ba28-ec4fa875ade8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.224202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa00c5-d126-4630-ba28-ec4fa875ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.253797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2ffa00c5-d126-4630-ba28-ec4fa875ade8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:45.255840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2ffa00c5-d126-4630-ba28-ec4fa875ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:45.258298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.288996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f49df0-017c-4519-8981-4d10a5807831 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.331191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.331802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.332074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.332341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.333152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:45.333609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.334967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.340746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 450/901] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:45.347082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.361606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 452/902] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:45.363257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da3e9-9d15-4cb0-90b0-d0348ab28df4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.363915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da3e9-9d15-4cb0-90b0-d0348ab28df4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.364499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778da3e9-9d15-4cb0-90b0-d0348ab28df4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.366344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 453/903] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:45.371035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.371562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.372057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.392398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:45.394041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:45.464377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9caa5-edca-47bd-bff2-4cd9ac205964 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.471965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 454/904] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:45.499632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.500293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.501193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.501630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.502516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] RBAC: Adding query filter params (interface=public, service_id=1b606c0ae3e14a9e9cce2457c5c701a7, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:45.502823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.504166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.509679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 451/905] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:45 2022] GET /identity/v3/endpoints?service_id=1b606c0ae3e14a9e9cce2457c5c701a7&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:45.514875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.561842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.622406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5641ad9-9dd9-44c3-aae2-ecf0e7c3419a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.637720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.640536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.662866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.663477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.663757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.664029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.664640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.666032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.673072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 455/906] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:45 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:47:45.748970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.758737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0bc84-da72-4f34-979f-90771ed073d1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.800649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.801294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.801597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.801871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.802461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.803924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:45.814610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:45.815595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:45.816468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 452/907] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 12:47:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:45.822616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:45.867077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.888449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4462-7216-4984-8b10-7716d49e4f01 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.909930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:45.934959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:45.935839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:45.936120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:45.936393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:45.937224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:45.939758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:45.946682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29e8f-eaae-47a3-94e5-b01b462c1046 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:45.960217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 456/908] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:45 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:47:46.005785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:46.006703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:46.007160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:46.007608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:46.008534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:46.009022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:46.010669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:46.018413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 453/909] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:46.026729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:46.139719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d994a-d167-4dc3-a2d7-13970f528662 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:46.175404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:46.176015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:46.176302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:46.176618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:46.177260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:46.177583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:46.178930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:46.189512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 457/910] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:46.190871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:46.302705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5a33-382d-410f-818b-062780cf0408 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:46.329579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:46.338774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:46.339381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:46.339660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:46.339932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:46.340644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] RBAC: Adding query filter params (interface=public, service_id=1ea722e4ec244d908f81be1612801a7f, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:46.340952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:46.342346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387aea9-2e66-4b64-a963-973343bdc731 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:46.348912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 454/911] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:46 2022] GET /identity/v3/endpoints?service_id=1ea722e4ec244d908f81be1612801a7f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:46.354794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:46.365461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:46.462974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5015a-3bfb-40a3-8fc6-b502f6f61712 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:46.497278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:46.497949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:46.498227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:46.498494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:46.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:46.500446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ac3fd-986a-4e02-8dc4-d038735911d8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:46.506665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 458/912] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:46 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:47:47.239904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47040-39c8-4ce5-bdb6-b642efaa74d5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.240446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47040-39c8-4ce5-bdb6-b642efaa74d5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.240446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47040-39c8-4ce5-bdb6-b642efaa74d5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.242130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 455/913] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:47.247176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbed6-d80e-4143-9f87-ad32e59ecddb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.247579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbed6-d80e-4143-9f87-ad32e59ecddb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.247760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbed6-d80e-4143-9f87-ad32e59ecddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.265803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1afbbed6-d80e-4143-9f87-ad32e59ecddb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:47.268285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1afbbed6-d80e-4143-9f87-ad32e59ecddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:47.331671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:47.336787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 459/914] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:47.618460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e47040-39c8-4ce5-bdb6-b642efaa74d5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:47.723015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38834-918f-4b0b-a003-70ecd8c4960f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.723394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38834-918f-4b0b-a003-70ecd8c4960f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.723570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38834-918f-4b0b-a003-70ecd8c4960f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.725126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 460/915] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:47.729854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a41-5625-48a6-b449-d51abf6d32d6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.730136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a41-5625-48a6-b449-d51abf6d32d6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.730413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf16a41-5625-48a6-b449-d51abf6d32d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.731175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e47040-39c8-4ce5-bdb6-b642efaa74d5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:47.751794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4bf16a41-5625-48a6-b449-d51abf6d32d6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:47.752985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4bf16a41-5625-48a6-b449-d51abf6d32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:47.775050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:47.776110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.776396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.776674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.790323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:47.796545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:47.797826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:47.799365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 456/916] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:47:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:47.804232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:47.836034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 461/917] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:47.855990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:47.909049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9ef60-5abb-4af2-9305-0ddc20c1386c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:47.944676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:47.945279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.945587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.945866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.946537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:47.946837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:47.948200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:47.951016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbec-3227-458b-a808-cfeadc6a7600 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.951305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbec-3227-458b-a808-cfeadc6a7600 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.951580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbec-3227-458b-a808-cfeadc6a7600 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.953029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 462/918] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:47.957501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 457/919] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:47:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:47.962769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:47.962886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:47.963172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:47.963374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:47.987653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:47.988832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:48.060385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 463/920] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:48.076693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80360bb-b7e5-448d-8ede-542349ffce97 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.097842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.123894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.124282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.124527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.124807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.125082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.136987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.138468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:48.153330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:48.154346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:48.155217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:48.155217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:48.155217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:48.155217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 458/921] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:48.160637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.188530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.232170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556486c8-df9e-4077-a4f1-a51d0f273205 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.268891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c093-f4d6-487b-be53-8d4071916164 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.269903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.270532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.270809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.271075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.271655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.272999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:48.282109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:48.284329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:47:48.286449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.289511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 464/922] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:48.289511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.305925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.306532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.306813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.307090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.307737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:48.308039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.309408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.322627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 459/923] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:48.328024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.354839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.395576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed246b-10f7-464c-aa7a-af53d711dc7b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.419889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.433422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.434056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.434291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89257a-440a-4429-83f1-9952186d8f7a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.434412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.434596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.435209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:48.435511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.436855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.443443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 465/924] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:48.444644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.475639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.476623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.477125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.477662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.486559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.488338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:48.501080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:48.502744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:48.504147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:48.505035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 460/925] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:48.505892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.563303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5aa44-0cbc-4881-a9f3-a4363c0bb546 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.590191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.597398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.598052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.598337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.598614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.599196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.600554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.605980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e67bc-b3f0-4a93-b9ec-b80f38edd925 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-16e9db4f-890d-4150-b9ec-0e05a7a97f48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:48.609246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:48.610441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:48.611298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 466/926] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:48.612118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779db14-e6a4-4bb0-87ea-88557bac6b11 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.612118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779db14-e6a4-4bb0-87ea-88557bac6b11 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.612581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779db14-e6a4-4bb0-87ea-88557bac6b11 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.613517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 467/927] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:48.614208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779db14-e6a4-4bb0-87ea-88557bac6b11 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.644624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.645229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.645530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.645808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.646434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:48.646739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.648085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.652842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 461/928] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:48.653634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.668135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.715982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779db14-e6a4-4bb0-87ea-88557bac6b11 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.748967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.749591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.749872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.750148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.750988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:48.751287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.752693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46148-3b8d-40ab-a7e1-b40278b178c9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.755671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2811be-6c84-495e-89ab-c53e4fcd6014 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.769694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 468/929] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:48.770865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.771152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.771531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.788732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:48.789963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:48.793084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.793984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.794266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.794542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.795175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:48.795479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.796832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.802357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 462/930] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:48.803127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.820575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.861469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 469/931] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:48.862334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:48.910818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aec0-8cb3-4d8d-81a4-ef68becc6f48 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:48.928094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:48.947200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:48.947834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:48.948114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:48.948387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:48.949054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:48.950444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:48.973643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 463/932] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:48.974709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.003756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c062f07-e7db-42eb-a9c2-1032072deb33 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.059847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.068086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.068526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.068804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.069075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.083384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.085672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:49.105199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:49.106246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:49.107194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:49.107194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:49.107194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:49.109647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 470/933] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:49.113862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.120842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ffcb2-e7fc-48a6-bf36-254e97a6c65d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.163261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.163950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.164226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.165132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.165132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.165425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.166830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.178377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 464/934] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.178377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.230398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.244279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c749-5644-4880-81ab-69146229f22c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.279427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.280055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.280290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.280565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.281210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.282070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.282894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b9e4-3a50-4342-be85-8e3cb7238413 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.284135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.297039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 471/935] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.299317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.318012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.325114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.325997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.326439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.326864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.327606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.329758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:49.338852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:49.339981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:47:49.341062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:49.343123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 465/936] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:49.344550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.411583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12df9-e000-4903-b53e-77a5c5c037c7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.449076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.449776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.450053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.450322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.451129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] RBAC: Adding query filter params (interface=public, service_id=601647af217a414bb3bfd8f3e5e77fcd, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.451552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.452909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.454965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd29a82-3adb-458a-90c1-bd5b7ca3b303 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.465408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 472/937] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/endpoints?service_id=601647af217a414bb3bfd8f3e5e77fcd&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.465408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.479957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.501220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.501815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.502097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.502364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.509173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.510657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:49.523578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:49.524501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 466/938] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:49.525396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.584236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.595177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb1f2-bfaa-414c-b876-9e4c7de322e1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.630688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.631283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.631557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.631826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.632446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.632744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.632847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966800c-c498-4d9a-a6f3-4dff60bfe303 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.634110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.644446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 473/939] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.644446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.669756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.670353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.670647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.670902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.671533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.672954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.689531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 467/940] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:47:49.689531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.746038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.778403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325aa8-d0d9-440c-bd4a-0b7cedfbdb72 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.810824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280f76-a2ce-4830-80be-d351f5f83179 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.824930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.825845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.826124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.826892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.827619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.828197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.830758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.834995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:49.852095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 474/941] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.857691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:49.858384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:49.858653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:49.858929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:49.859574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:49.860840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:49.861332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:49.862493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.867894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 468/942] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:49.873315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:49.992095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3804c5-01a8-4691-8709-756a12e96b37 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:49.992550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64da0f-19fd-4ea9-8d44-fa51a4e3a75a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:50.030062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:50.030586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:50.030973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:50.031301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:50.032601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:50.034003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c28d11-8135-45f3-b37c-ab02422135d0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:50.036998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:50.037862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:50.038140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:50.038591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/fcdafb2881494434ae9e742a103117bb/roles/04c305da2ad7457cb733d92d4706c785` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:50.041450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=fcdafb2881494434ae9e742a103117bb, role_id=04c305da2ad7457cb733d92d4706c785)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:50.043451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d77f-e451-487f-b1cf-2bea1fd5b9f3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:50.048267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:50.058423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 469/943] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:47:50.060016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 475/944] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:47:49 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/fcdafb2881494434ae9e742a103117bb/roles/04c305da2ad7457cb733d92d4706c785 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:47:51.057594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1717b-72eb-468f-9714-d547b99f5623 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.058154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1717b-72eb-468f-9714-d547b99f5623 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.058154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1717b-72eb-468f-9714-d547b99f5623 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.059563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 470/945] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:51.064922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.065786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.066282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.085312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:51.086841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:51.181764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 476/946] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:51.479056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1717b-72eb-468f-9714-d547b99f5623 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:51.526544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:51.591043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1717b-72eb-468f-9714-d547b99f5623 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:51.627434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:51.628051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.628328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.628598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.629260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:51.630722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:51.633434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING keystone.server.flask.common [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 12:47:51.655046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.sql.core [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:47:51.655046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:47:51.655046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [parameters: {'id': '7b41d1f6a18f42dca22b1d22383b51ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:47:51.655046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81513) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ce7c4f7b-ddd7-4cd9-a8bb-2fd93b161c90 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b41d1f6a18f42dca22b1d22383b51ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b41d1f6a18f42dca22b1d22383b51ff. Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:47:51.673779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 12:47:51.674645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application yield resource Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise self.value Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application session.commit() Aug 31 12:47:51.675579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:47:51.676456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:47:51.677358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:47:51.679894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [parameters: {'id': '7b41d1f6a18f42dca22b1d22383b51ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:51.681986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:51.683981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b41d1f6a18f42dca22b1d22383b51ff. Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:51.694525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 471/947] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 31 12:47:51 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:51.695079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:51.792874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6b12-d958-4f11-8695-d9c661a45a90 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.793058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6b12-d958-4f11-8695-d9c661a45a90 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.793727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6b12-d958-4f11-8695-d9c661a45a90 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.802501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 472/948] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:51.802643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb408-57ef-496a-8904-3f807cfbe35b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:51.804810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833c10-1cc9-4662-bda5-8532431f48ae None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.805283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833c10-1cc9-4662-bda5-8532431f48ae None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.805711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833c10-1cc9-4662-bda5-8532431f48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.825466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dd833c10-1cc9-4662-bda5-8532431f48ae None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:51.826318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:51.828900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dd833c10-1cc9-4662-bda5-8532431f48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:51.839375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:51.840008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:51.840288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:51.840562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:51.848507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:51.849894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:51.862256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:51.863372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:51.864262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 477/949] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:51.869133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:51.913683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 473/950] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:51.980088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43ab0-3a39-47ab-a67e-279ac36c2305 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.014465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.015071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.015350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.015625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.016871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:52.017285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.018742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512cc90-7753-4be2-8ed5-716f48dbff50 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.024103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43196-1cf0-44b3-9f9d-eb80f7134a4b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.024382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43196-1cf0-44b3-9f9d-eb80f7134a4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.024653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43196-1cf0-44b3-9f9d-eb80f7134a4b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.027209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 474/951] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:52.031062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.031341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.032221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.037351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 478/952] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:52.052490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:52.053660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:52.082308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.130008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc518a-0f5b-4e4a-88db-d75c951f6ec8 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.130977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc518a-0f5b-4e4a-88db-d75c951f6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.131510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc518a-0f5b-4e4a-88db-d75c951f6ec8 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.133357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 479/953] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:52.138982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.139570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.139696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 475/954] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:52.140169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.163354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:52.164661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:52.203628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.205406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.243847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 480/955] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:52.317564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16c2a3-0645-4823-948e-f68b2dc225c1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.353265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.353935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.354482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.354755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.355341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.356898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:52.366436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:52.367521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:52.368393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 476/956] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:52.373663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.405943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.434899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.497204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47782a03-fd6b-4282-a044-3207a31d7b75 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.540610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.541217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.541510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.541783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.541983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0cad-1d58-4592-abb3-b47cc8a15755 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.542411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:52.542709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.544299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.553790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 481/957] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:52.553790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.585048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.585974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.586560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.586822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.587090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.600081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:47:52.607564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:52.608722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 477/958] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:52.610145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.665639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6967c-a1bd-4c40-a37a-d7f19a3652ba None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.700845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.703991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.704619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.704902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.705179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.705791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.707147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:52.716039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:52.717100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:52.717971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 482/959] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:52.718755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.725629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb18d-cb85-460d-a379-fd245258872a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.763896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.764495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.764774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.765045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.765705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:52.766205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.767379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.772741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 478/960] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:52.773540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.832735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:52.836533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0863-b41c-41df-b48c-e638774b7b62 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.879305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.879910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.880429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.880709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.881857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:52.882160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.883818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.894541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a9053-60ef-4855-a361-0b4c9fcd4ca9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:52.897468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 483/961] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:52.898541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.934726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:52.935349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:52.935639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:52.935918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:52.936557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:52.936861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:52.939118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:52.944679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 479/962] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:52.945320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:52.959156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.015477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758551-5cb0-4b65-9364-67f008e4da21 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.052431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.053035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.053313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.053412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30142-454b-4efc-be01-fa9a96bfdd6e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.053633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.054287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.056575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.080788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 484/963] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:47:53.081692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:53.113046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.116803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.117525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.117815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.118085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.133879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.136799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:53.158478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:53.159514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:53.160419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:53.160419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:53.160419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:53.161650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 480/964] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:53.165767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:53.223042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c393faa-f0cf-434f-a97e-228a2c728ef0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.257235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.263487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.264100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.264386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.264656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.265352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:53.266295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.267815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.276641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 485/965] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:53.315626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28df15-a463-45f9-87b2-d856179af69c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.354989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.355528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.355802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.356128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.356798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:53.357099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.358677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.372965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 481/966] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:53.379312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:53.467590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.488962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2277f-037e-4da0-b2de-0a141b358908 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.524434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.525063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.525340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.525641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.534226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.535665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:53.548449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:53.549407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:53.550384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 486/967] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:47:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:53.555677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:53.663004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388074c-248b-4dea-8c40-36b886722f80 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.682037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.701966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.702955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.704395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.704879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.705889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:53.706413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.708057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:53.727379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 482/968] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 12:47:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:53.732707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:53.840049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a783-5aff-45c5-9168-03c7b29c10cd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:53.875823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:53.876428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:53.876702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:53.876969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:53.897019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:53.949015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:53.950392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bfb1a-e077-4f27-abdb-7adae9f6a960 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.053578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 487/969] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:47:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:47:54.059020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.173614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53a3fd-62cb-4474-9796-c92b9389d77b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.183387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252608-3068-4939-a866-e91560a22136 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.183668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252608-3068-4939-a866-e91560a22136 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.183942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252608-3068-4939-a866-e91560a22136 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.186600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 488/970] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:54.191316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.191595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.191868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.213322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:54.214471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:54.220442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.221139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.221425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.221775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.236239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.238853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:47:54.259611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:54.260633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:47:54.261537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:47:54.261537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:47:54.261537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.263180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 483/971] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:54.263728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.270489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.306997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 489/972] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:54.308129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.394167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8d8c8-0992-4abd-b9fc-b805508037b9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.433237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.433894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.434170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.434438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.435079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:54.435375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.436720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.449505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 484/973] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:54.455450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.562319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a086204-a20c-43a1-bdf3-6e36ab49a775 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.586407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.602468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.603209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.603486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.603757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.612029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.613767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:47:54.627832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:54.628757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:54.629708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 490/974] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:54.634777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.667666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.694832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.714628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afe628-b106-405f-bda3-7d50ab0e36c7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.749869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391dc1-18a0-4f2f-999a-6b9cd307e6b4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.757016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.757743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.758091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.758429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.759156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.760646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.776505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.sql.core [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:47:54.776505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:47:54.776505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [parameters: {'user_id': 'a12272f20f564129a4629ad44def2348', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:47:54.776505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81513) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Aug 31 12:47:54.784790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:47:54.786809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application yield resource Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise self.value Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application session.commit() Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:47:54.788174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:47:54.789516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:47:54.790999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:47:54.792026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a12272f20f564129a4629ad44def2348', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:54.802030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 12:47:54.803760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.805728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 485/975] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 12:47:54 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:54.806522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.806673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.806801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.815580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 491/976] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:54.817044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:54.915862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:54.916290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2e2d-40db-4ed3-8c16-d24c97ebfdaf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.926031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b94bc-751b-411a-a5e0-55d265eef0fc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:54.958672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.959608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.960071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.960496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.964163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:54.964675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:54.964954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:54.965235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:54.965995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] RBAC: Adding query filter params (role.id=04c305da2ad7457cb733d92d4706c785, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=fcdafb2881494434ae9e742a103117bb) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:54.966298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.967694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.969938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:54.971902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:54.982024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 492/977] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/role_assignments?user.id=fcdafb2881494434ae9e742a103117bb&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=04c305da2ad7457cb733d92d4706c785 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-935ca1f4-5917-42ba-b07a-da5e68d12a8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:47:54.986009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:54.987342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:47:54.988400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:54.990703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 486/978] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:54.997523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:55.122645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c05d-21fb-444c-8d7c-9740ba90434c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:55.161373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:55.162014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.162294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.162564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.163324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:55.163631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:55.165042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c2f0-1601-43b5-853e-12f6ca655c4d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:55.202820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 493/979] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 12:47:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:55.250840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247cbc7-d427-4317-b78f-2c747c495c28 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.251370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247cbc7-d427-4317-b78f-2c747c495c28 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.251370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247cbc7-d427-4317-b78f-2c747c495c28 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.256182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 487/980] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:55.262128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.262405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.262687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.284320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:55.285616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:55.297933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:55.355156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c455-a11d-4c36-b958-6ce231eb3d2c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.355428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c455-a11d-4c36-b958-6ce231eb3d2c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.355697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c455-a11d-4c36-b958-6ce231eb3d2c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.357324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 488/981] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:47:55.362948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.363228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.363500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.364838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 494/982] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:55.381960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:55.383453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:55.385602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:55.463459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 489/983] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:55.641318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:55.735580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:55.743592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e532cf-a432-468d-b3b8-aa23ddec7c9b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:55.780693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:55.782009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.782423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.782703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.783299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:55.784672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:55.794563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:55.795655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:55.797670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 495/984] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:55.802225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:55.813401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:55.849186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc0a2-535d-4c6c-8a2f-d30329cc2781 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:55.885943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:55.886633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.886971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.887410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.887968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:55.889352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:55.900380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:55.913540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 490/985] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:47:55 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:47:55.918785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0443a-c772-4793-bbfe-d99fe13a6be1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:55.967976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:55.968590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:55.968958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:55.969233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:55.970088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:55.970458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:55.971918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:55.982127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 496/986] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:55.983537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:56.107403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de62f-b0b8-4f09-93c8-068160591669 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:56.143885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:56.144498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:56.144780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:56.145057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:56.145725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:56.146034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:56.147394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:56.152642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 491/987] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:56.159648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:56.239049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:56.279519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d315-c1a1-485c-b90a-3e413e24ea39 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:56.317819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:56.318480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:56.318737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:56.318957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:56.319667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] RBAC: Adding query filter params (interface=admin, service_id=601647af217a414bb3bfd8f3e5e77fcd, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:56.319973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:56.321320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d59b9-c05f-4637-93ae-e20eb2f29668 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:56.327221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 497/988] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Aug 31 12:47:56 2022] GET /identity/v3/endpoints?service_id=601647af217a414bb3bfd8f3e5e77fcd&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:56.335316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:56.410959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:56.456551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b4ba5-7635-4925-985b-0beb48eec88e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:56.498475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:56.499091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:56.499370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:56.499647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:56.501334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:56.502355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618a2f0-e762-4faa-9bcf-a737ab41fde1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:56.517536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 492/989] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:56 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:47:57.126588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e070d2-1b12-42c5-8cb7-3bf630a19422 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.126881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e070d2-1b12-42c5-8cb7-3bf630a19422 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.127137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e070d2-1b12-42c5-8cb7-3bf630a19422 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.128601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 498/990] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:57.133528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.133816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.134090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.152327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:57.153509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:57.221266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 493/991] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:47:57.494533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e070d2-1b12-42c5-8cb7-3bf630a19422 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:57.597770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e070d2-1b12-42c5-8cb7-3bf630a19422 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:57.626906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:57.633173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:57.633850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.634131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.634399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] PATH_INFO: `/v3/services/image` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.634993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:57.636374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:57.646185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:57.647210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:47:57.648088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:57.649810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 499/992] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 12:47:57 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:57.653068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:57.712149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:57.756958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e57b6-29f3-41db-a1ba-e93fe2acb482 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:57.792736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:57.793621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.793904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.794176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.794807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] RBAC: Adding query filter params (name=image) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:57.795110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:57.796469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b638-d3cc-4c49-8e3f-bbffec5c015b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:57.806122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 494/993] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:57.807173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:57.914054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4dbe0-9b16-4535-9b3f-32db198b898c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:57.936218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44936cd7-1725-4639-a381-198cbb7033cd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.936504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44936cd7-1725-4639-a381-198cbb7033cd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.936778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44936cd7-1725-4639-a381-198cbb7033cd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.938824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 495/994] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:57.943875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd27c3-9e27-4b86-91a3-88357caa65f1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.944159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd27c3-9e27-4b86-91a3-88357caa65f1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.944433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd27c3-9e27-4b86-91a3-88357caa65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.955204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:57.955811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:57.956091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:57.956363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:57.956994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] RBAC: Adding query filter params (type=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:57.957750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:57.959107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:57.962731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3fcd27c3-9e27-4b86-91a3-88357caa65f1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:57.963984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 500/995] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:47:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:57.964093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3fcd27c3-9e27-4b86-91a3-88357caa65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:58.045980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 496/996] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:58.317848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.392859 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:58.436739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a80a99-a866-4bc0-8298-1cf6153a963e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:58.468349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394a12-eaf0-4b0b-ba19-cbf6025f7e8a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.469146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394a12-eaf0-4b0b-ba19-cbf6025f7e8a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.469589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394a12-eaf0-4b0b-ba19-cbf6025f7e8a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.470941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 497/997] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:58.474517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:58.475428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.475708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.475976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.476085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.476258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.476534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.476637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:58.477915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:58.488166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:58.489217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:47:58.490173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 501/998] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:47:58.496808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.501443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:58.502660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:58.555418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:58.582004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 498/999] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:47:58.603263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9f10-8b6f-4e3d-9d3d-55601e7161e0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:58.627631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:58.639114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:58.639717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.639993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.640263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.641459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:58.641777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:58.643175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:58.648178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 502/1000] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:58.653613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.756350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fde34-82ad-4c4d-b726-3aaa3417b1bf None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:58.789029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:58.789660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.789941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.790211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.790834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:58.791132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:58.792482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:58.798292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 499/1001] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:58.803853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.847025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.895408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:58.913722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b7df4-44fe-438c-93b1-7d8a1202c131 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:58.950606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:58.951025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.951303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.951564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.952262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] RBAC: Adding query filter params (interface=public, service_id=5b2e1fd2382447f5b703c4860d769d0c, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:58.952571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:58.954819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:58.958169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aa9a7-7361-4439-9482-c7fff00d4891 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:58.961121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 503/1002] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/endpoints?service_id=5b2e1fd2382447f5b703c4860d769d0c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:58.966018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:58.997967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:58.998645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:58.998926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:58.999200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:58.999794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:59.001878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:47:59.011067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:47:59.012324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:47:59.013379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:47:59.014359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 500/1003] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:47:59.020391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:59.029705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:59.086354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb730-cdd4-49fb-8a69-88df7e11e85d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:59.129600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:59.130460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.130737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.131006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.131854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:59.133845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:59.134936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896edd8-4d5a-448d-953b-027a916bb5c7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:59.142160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 504/1004] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:47:58 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:47:59.145980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:59.176056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:59.176686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.176967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.177237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.177931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:59.178239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:59.179635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:59.185386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 501/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:47:59.191170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:59.303491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575b01-033d-4c5f-b2ed-7d47ddf57c50 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:59.321615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:47:59.341244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:59.341879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.342161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.342533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.343170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:47:59.343473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:59.345566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c9620-0b4f-4639-b499-5d844c409da4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:59.353509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 505/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 12:47:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:47:59.356547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:47:59.458517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9cf19-24f9-4f8a-ad1f-f08ace965c97 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:47:59.492961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:47:59.493591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.493930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.494205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.494868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:47:59.496213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304ddd7-f420-488c-bedd-c1335dd408d6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:47:59.517524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 502/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:47:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:47:59.925447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d2-871c-47e7-a7ce-4f295ef645bd None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.926019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d2-871c-47e7-a7ce-4f295ef645bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.926019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d2-871c-47e7-a7ce-4f295ef645bd None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.927390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 506/1008] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:47:59.932471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba01-4f26-441c-a265-af81b72705e6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:47:59.932864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba01-4f26-441c-a265-af81b72705e6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:47:59.933044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797ba01-4f26-441c-a265-af81b72705e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:47:59.952111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4797ba01-4f26-441c-a265-af81b72705e6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:47:59.954268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4797ba01-4f26-441c-a265-af81b72705e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:47:59.982135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:00.032564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 503/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:47:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:00.302891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac4d2-871c-47e7-a7ce-4f295ef645bd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:00.404577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac4d2-871c-47e7-a7ce-4f295ef645bd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:00.437914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:00.438578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:00.438857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:00.439126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:00.439780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:00.441136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f541066-7548-4f1b-afe7-efb155d1c93f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:00.456977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 507/1010] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:48:00 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:01.116362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f359-b8f9-45ad-b236-1c38c7877de9 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.116817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f359-b8f9-45ad-b236-1c38c7877de9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.116913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f359-b8f9-45ad-b236-1c38c7877de9 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.118551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 504/1011] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:01.123645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9808b0-0e2c-41e4-a8e3-07632af5751f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.124017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9808b0-0e2c-41e4-a8e3-07632af5751f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.124203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9808b0-0e2c-41e4-a8e3-07632af5751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.142331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0e9808b0-0e2c-41e4-a8e3-07632af5751f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:01.143517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e9808b0-0e2c-41e4-a8e3-07632af5751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:01.178479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:01.220204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 508/1012] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:01 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:01.439225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cf4c-32f1-4056-8261-4e1a5787e7b6 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.439559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cf4c-32f1-4056-8261-4e1a5787e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.439735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cf4c-32f1-4056-8261-4e1a5787e7b6 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.441140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 505/1013] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:01.446088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.446377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.446652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.464770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:01.465965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:01.491003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cf4c-32f1-4056-8261-4e1a5787e7b6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.538913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 509/1014] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:01 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:01.601289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cf4c-32f1-4056-8261-4e1a5787e7b6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:01.635385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:01.636010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.636288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.636561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.637141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:01.638538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:01.647874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:01.648839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:01.650490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 506/1015] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:48:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:01.655048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.753008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:01.760355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e43f-7f18-404f-896a-df2c929a3de5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:01.795374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:01.795987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.796269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.797271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.797883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:01.798193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:01.799560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:01.810221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 510/1016] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:48:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:01.810397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.811037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.834872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:01.915784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90962fc-2ab3-4af0-98ba-0491c3b80564 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:01.916198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592c094-7730-42ed-9afb-971b33341735 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:01.952417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:01.952630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:01.953253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.953365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:01.953644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.953745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:01.953954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.954064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:01.954673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:01.954970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:01.955066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:01.956317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:01.956503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:01.958261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 507/1017] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:01.966476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 511/1018] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 12:48:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:01.966635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.967350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:01.994807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:02.068291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:02.071624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bfe60-b4ac-4114-a3f9-43e3ed68722b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:02.081139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef7f8-6ff1-452c-9aba-cd4c5c9b194d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:02.110090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:02.110706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:02.110987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:02.111261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:02.111932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:02.113287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb86317-74c9-4ac5-a7a7-e509895753ed None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:02.123767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:02.124379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:02.125265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:02.125609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:02.126385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:02.127836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408de7-1793-49a9-b166-674292912a15 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:02.137871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 512/1019] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:48:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:02.162226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 508/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:48:01 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:02.383529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a69e3-f455-4abb-8f8c-af5173ba72a0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:02.383820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a69e3-f455-4abb-8f8c-af5173ba72a0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:02.384097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a69e3-f455-4abb-8f8c-af5173ba72a0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:02.385731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 513/1021] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:02.390730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:02.391007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:02.391287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:02.409793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:02.410985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:02.488523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 509/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:02.754006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a69e3-f455-4abb-8f8c-af5173ba72a0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:02.835885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:02.858334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a69e3-f455-4abb-8f8c-af5173ba72a0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:02.892658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:02.893287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:02.893592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:02.893867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] PATH_INFO: `/v3/services/image` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:02.894447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:02.895797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:02.904900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:02.906590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:02.907777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:02.914633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 514/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 12:48:02 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:02.914811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:02.980270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:03.016862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e50d75-6577-4dfe-adc9-048392b4c690 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:03.050836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:03.051446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:03.051725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:03.051995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:03.052625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] RBAC: Adding query filter params (name=image) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:03.052925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:03.054307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:03.059292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 510/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:03.065623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:03.177695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391999-bbdc-4a78-9f49-d33dd593ef96 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:03.211512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:03.212116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:03.212399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:03.212676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:03.213308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] RBAC: Adding query filter params (type=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:03.213722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:03.215083 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:03.220387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 515/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:03.226247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:03.330673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b4f40-c2c8-4890-a500-95443a503251 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:03.364573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:03.371165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:03.371777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:03.372056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:03.372330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:03.373039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] RBAC: Adding query filter params (interface=public, service_id=3d9160b8c5404138a20f96a722d20502, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:03.373348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:03.375311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6a008-c6d7-4d54-add2-592cc4ff23cb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:03.384990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 511/1026] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:48:03 2022] GET /identity/v3/endpoints?service_id=3d9160b8c5404138a20f96a722d20502&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:03.386251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:03.397698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:03.489362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93805a70-4a6b-4b30-aa1f-2d540d9c1687 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:03.523658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:03.524257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:03.524543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:03.524802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:03.525394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:03.526770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70da4c0-8102-4bb8-b195-49ef6e49058c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:03.533254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 516/1027] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:48:03 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:48:04.198967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635dab-2453-4d7f-8893-5acaf6b2a307 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.199166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e47e-07ee-43f2-896f-71b90d409a3a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.199601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635dab-2453-4d7f-8893-5acaf6b2a307 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.199690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e47e-07ee-43f2-896f-71b90d409a3a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.199764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635dab-2453-4d7f-8893-5acaf6b2a307 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.199833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e47e-07ee-43f2-896f-71b90d409a3a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.200960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 512/1028] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:04.201138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 517/1029] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:48:04.205864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.206138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.206392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.206513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.206671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.206946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.225432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:04.226633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:04.227361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:04.228536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:04.298182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 513/1030] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:04.305768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 518/1031] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:48:04.567933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:04.568124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:04.571014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:04.676301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581fdc-14b7-45ac-b3fc-f0f14180cab3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:04.681163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e702-0608-4eb5-aed2-fc6114c6c994 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:04.709137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:04.710346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:04.710984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.711297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.711602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.712730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:04.714163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:04.721026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 519/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:04.721162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:04.721932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:04.722680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.722939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.723207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.733903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:04.739033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:04.739963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:04.740819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 514/1033] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:48:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:04.746290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:04.799449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:04.836395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d541e-412d-4092-bc23-e18a3ca8423d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:04.847530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3a5fe-e098-4f3f-9113-a381e01aab16 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:04.879088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:04.879970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.880426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.880709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:04.881111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.881306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:04.881611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:04.881881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:04.882529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:04.882633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:04.882828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:04.884188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:04.884548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:04.892925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 515/1034] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:48:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:04.898613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:04.912323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 520/1035] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:48:04 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:48:04.964182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:05.027268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f8fd-30dd-4dc0-9362-72223c545a63 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:05.065179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:05.066679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.066679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.066679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.078367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:05.079770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:05.094946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:05.095927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:05.096842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:05.096842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:05.096842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:05.096842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 516/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:05.101961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.207229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddcff-731a-44ae-bade-042f1f312098 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:05.233059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:05.244260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:05.245127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.245643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.246097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.246948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:05.247428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:05.248971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:05.262019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 521/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:05.267655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.370050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:05.373618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c714d-b131-4862-b91f-38c642781757 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:05.409557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:05.410184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.410458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.410731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.418586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:05.419997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-cd82b5f5-bb45-40a1-9b8c-5990d6ca75b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:48:05.431235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:05.432186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:05.433124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:05.437117 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 517/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:05.438160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.497797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d8df-849b-4ff2-b1b6-75578be83dca None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.498123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d8df-849b-4ff2-b1b6-75578be83dca None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.498359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d8df-849b-4ff2-b1b6-75578be83dca None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.503386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 518/1039] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:48:05.505105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.505611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.505887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.525231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:05.526435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:05.548611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee18b1-3223-46b7-bcc5-594af9f61e51 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:05.585050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:05.585842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.586020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.586318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.587050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:05.587355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:05.588766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:05.600795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 519/1040] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:48:05.612093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 522/1041] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:05.615323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.705870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:05.716471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5df65-2a91-4585-a603-098e6d8c3e03 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:05.753300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:05.753942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:05.754228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:05.754504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:05.822151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:05.823615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:05.898882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.913639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:05.929774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 520/1042] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:05.931548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:05.947790 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.007321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7755c-d518-497c-bb31-56c2abc28aa8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.040050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabbbc-babb-425b-802c-3c5e51dcbbc2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.042494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.043371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.043644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.043912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] PATH_INFO: `/v3/services/image` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.044481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.045846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:06.055176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:06.056262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:06.057807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 523/1043] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:06.062220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.083406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.084311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.084718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.085124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.099835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.101932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:06.119320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:06.120326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:06.121207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:06.121207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:06.121207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:06.121207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 521/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:06.127398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.176699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.183954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399af6-393e-472d-b85c-3a32361b9aad None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.194655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.221120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.221766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.222123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.222392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.223010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] RBAC: Adding query filter params (name=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:06.223307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.224645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.233638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 524/1045] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:06.236309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.238033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46b454-374d-4813-b2aa-d7afb434f6f7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.272020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.272636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.272817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.273085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.273763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:06.274071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.275419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.287181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 522/1046] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:06.292680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.349042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2197d2-01ea-44b1-9886-aa55c2551e9e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.387037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.387641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.387925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.388217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.388832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] RBAC: Adding query filter params (type=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:06.389139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.390647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.395813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 525/1047] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:06.399941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042606ac-77cb-41e7-bf5b-86e77bec4050 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.401690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.402381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.440326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.441539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.442337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.443034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.445634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.454640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.456228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:48:06.468013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:06.469804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:06.470967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:06.471826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 523/1048] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:06.477447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.531267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f8dc9-556c-41c2-b87f-17501d42abbe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.571911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.572617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.572967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.573313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.574109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.575478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.584826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9b2c4-b4cd-4adb-8909-e92986869854 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.609623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 526/1049] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:48:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:48:06.632655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.633419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.633782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.634148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.634923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:06.635294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.636793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad6c4-444a-44dc-bb35-283d39095175 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.657711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 524/1050] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:06.660857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:06.769454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:06.781223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55bc8-79de-45e1-8695-35c71e2c9901 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:06.818081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:06.818612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.818891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.819164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.819902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] RBAC: Adding query filter params (role.id=04c305da2ad7457cb733d92d4706c785, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:06.820213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:06.821662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995f0e-c522-4777-b907-a04c760942c7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:06.827567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 527/1051] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:06 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=04c305da2ad7457cb733d92d4706c785 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:06.920178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4063e-a297-4df2-8faa-d0b81a115283 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.920536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4063e-a297-4df2-8faa-d0b81a115283 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.920718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4063e-a297-4df2-8faa-d0b81a115283 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.922863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 525/1052] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:06.928672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:06.928996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:06.929224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:06.949056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:06.950494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:07.024755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 528/1053] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:07.299490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4063e-a297-4df2-8faa-d0b81a115283 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:07.319381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:07.403920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4063e-a297-4df2-8faa-d0b81a115283 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:07.437954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:07.438574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:07.438848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:07.439115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:07.449085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:07.454245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:07.455264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:07.458522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 526/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:07.461325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:07.548687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:07.564327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417e985-6f82-49d2-a722-6fa8fd441e5e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:07.599715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:07.600321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:07.600598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:07.600869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:07.601555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:07.601857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:07.603198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:07.616866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 529/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:07.618179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:07.703642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:07.729151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786033-f9be-49be-b60a-3141d20f6336 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:07.763863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:07.764488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:07.764766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:07.765039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] PATH_INFO: `/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:07.779095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] RBAC: Authorizing `identity:get_user(user_id=e3ec0c5fb4804b59bdce2f8893bb4a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:07.780530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:07.787939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 527/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:07 2022] GET /identity/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:07.789134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:07.893511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047488c-1f73-49bf-a4ea-36d2a6a4fe09 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:07.926913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:07.927543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:07.927821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:07.928094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:07.948474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:08.000529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:08.002007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:08.115547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 530/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:48:08.116895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:08.217324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e963-5df9-4857-bf04-df68a667ddda None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:08.252943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:08.253509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.253791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.254064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.255180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:08.256602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34439-e601-499e-b8f4-3e2a4756a412 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:08.263197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 528/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:08 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:08.264382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:08.315632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:08.367724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a0fd-65b5-445f-861a-e9188ea6cbab None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:08.401777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:08.402371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.402645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.402911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.403627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=6dbc866e5ace48b68f69fc43211df719, user.id=e3ec0c5fb4804b59bdce2f8893bb4a24) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:08.403929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:08.405331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568de8-486a-455e-8b18-7ba4a52a46d5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:08.411579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 531/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:08 2022] GET /identity/v3/role_assignments?user.id=e3ec0c5fb4804b59bdce2f8893bb4a24&scope.project.id=6dbc866e5ace48b68f69fc43211df719&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:08.552915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d400a-b4dc-4e7a-a9fe-07949ba94d56 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.553400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d400a-b4dc-4e7a-a9fe-07949ba94d56 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.553400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d400a-b4dc-4e7a-a9fe-07949ba94d56 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.554933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 529/1060] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:08.559822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c994-d0c4-4713-b0b2-47e01167d0df None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.560235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c994-d0c4-4713-b0b2-47e01167d0df None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.560398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c994-d0c4-4713-b0b2-47e01167d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.579342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1896c994-d0c4-4713-b0b2-47e01167d0df None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:08.580523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1896c994-d0c4-4713-b0b2-47e01167d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:08.650254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 532/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:08.767134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028431-d1f2-4096-9912-7eaf053f2ce7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.767498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028431-d1f2-4096-9912-7eaf053f2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.767842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028431-d1f2-4096-9912-7eaf053f2ce7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.769519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 530/1062] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:08.774573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:08.774862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:08.775136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:08.793855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:08.795027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:08.830628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:08.865209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 533/1063] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:08.916748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97028431-d1f2-4096-9912-7eaf053f2ce7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:08.921077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.024277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97028431-d1f2-4096-9912-7eaf053f2ce7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.067733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.068340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.068620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.068896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.133094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.138166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.139615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.143539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.239149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3e496-96cd-49c1-ba85-9d44967cb113 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.246106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 531/1064] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:09.251641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.277240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.278093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.278213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.278411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.291447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:09.296511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:09.297462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:09.298363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 534/1065] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:09.303561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.337704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.364688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32c9f-25d0-4bd3-94de-2eca3bcadbe9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.367643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.403704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.404331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.404605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.404878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.414094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b90f0-b875-448e-94d9-fcaf2e2807e7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.414903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.416333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:09.435767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:09.436755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:09.438434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:09.438434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:09.438434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:09.438434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 532/1066] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:09.443546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.454664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.455266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.455540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.455805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.456493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:09.456786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.458165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.471719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 535/1067] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:09.472796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.559466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098e05-4968-450b-959c-54aa59657c09 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.571655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.579526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35809a-5877-4e30-8d85-ed610c0cb0fc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.597715 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.598331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.598613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.598888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.599569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:09.599843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.601203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.613170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 533/1068] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:09.614069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.614683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.615011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.615226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.628623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.630639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:09.648070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:09.649130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:09.650061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:09.650061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:09.650061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:09.650543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 536/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:09.656225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.677133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:09.771591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b738-f73c-4f28-b20f-a084378cad8e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.806993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.807604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.807885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.808162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.808819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:09.809113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.810510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.822830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 534/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:09.829750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:09.944950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800364-1814-41dc-b803-2ac29a9287a0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:09.978086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:09.978701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:09.978974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:09.979242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:09.987051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:09.988455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:48:09.999278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:10.000294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:10.001372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 537/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:48:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:10.006359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.082762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.107620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ca93-824e-429c-acad-cf723fa9eb3a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.141424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.142034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.142307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.142577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.143290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:10.143588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.145000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.162766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 535/1072] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:10.168599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.177858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.267361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ead4-47e9-4d69-b1b7-cbaa613cf116 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.300999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.301644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.301922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.302189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.312441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.314029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-180dd5b1-7967-4415-9d8c-8a9988c190fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:10.327577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:10.328533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:10.329928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:10.329928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:10.329928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:10.329928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 538/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:10.334622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.338702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12ff2-c8ce-486b-a7a9-24779c42ef82 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.339016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12ff2-c8ce-486b-a7a9-24779c42ef82 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.339269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e12ff2-c8ce-486b-a7a9-24779c42ef82 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.340558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 539/1074] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:10.345892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.346544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.346825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.365278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:10.366506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:10.418213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.433867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 540/1075] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:48:10.434277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e583d-07a5-47ae-8113-21bf691ba8a8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.466483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.467076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.467347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.467610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.468766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:10.469062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.470439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.471813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.482149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 536/1076] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:10.488450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.583711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4242d5-c18f-44bc-9ccb-0fca1cfbf776 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.616257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.616874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.617164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.617412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.623870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.625303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:48:10.636114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:10.637036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:10.638352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 541/1077] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:10.643551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.706341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.742895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787cf6c-595c-4ada-b5ca-77d685634dd4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.758124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.776709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.777313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.777642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.777918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.778612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:10.778913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.780347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.792447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 537/1078] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:10.799548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.808898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcf96-8941-4a3a-96a3-04d60744208d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.842918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.844072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.844353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.844625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.854107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:10.855037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:10.860683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:10.861669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:10.862536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 542/1079] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:10.867756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:10.904159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985f02-97e5-4bd8-ad02-0c362532a283 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.938662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:10.939316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:10.939597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:10.939877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/04c305da2ad7457cb733d92d4706c785` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:10.942073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=e4e7f0ac2d354e1eac91ab2b91e5a89b, role_id=04c305da2ad7457cb733d92d4706c785)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:10.943506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:10.957027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 538/1080] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:48:10 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/e4e7f0ac2d354e1eac91ab2b91e5a89b/roles/04c305da2ad7457cb733d92d4706c785 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:48:10.967268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966aed-b4f2-4069-89d5-6ac928139da7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:10.977762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:11.004551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:11.005182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:11.005461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:11.005758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:11.006447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:11.006752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:11.008149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:11.019728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 543/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:11.026005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:11.135905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9854-ff2b-4364-be3c-c7bee20015ae None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:11.149858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:11.172334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:11.172991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:11.173275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:11.173582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] PATH_INFO: `/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:11.174717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ec0c5fb4804b59bdce2f8893bb4a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:11.176147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:11.177763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 539/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:11 2022] GET /identity/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:11.183670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:11.282576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1ee9-aeb1-4d06-9cba-242f21417ee9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:11.316225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:11.316848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:11.317128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:11.317403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:11.318542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:11.319949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43b03d-d227-4062-af6a-c20b87b982ec None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:11.321787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 544/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:11 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:11.327978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:11.426036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eecaf-21b2-4193-9f98-8f8b995b0972 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:11.459485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:11.460135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:11.460409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:11.460679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719/users/e3ec0c5fb4804b59bdce2f8893bb4a24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:11.462575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbc866e5ace48b68f69fc43211df719, user_id=e3ec0c5fb4804b59bdce2f8893bb4a24, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:11.463997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1909d83-c3b7-4794-9aa8-70802ca63e25 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:11.478600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 540/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:48:11 2022] PUT /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719/users/e3ec0c5fb4804b59bdce2f8893bb4a24/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:48:12.869193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478739e-ae81-4d63-83c5-1b1516c9fcfc None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:12.869777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478739e-ae81-4d63-83c5-1b1516c9fcfc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:12.869777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478739e-ae81-4d63-83c5-1b1516c9fcfc None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:12.871095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 545/1085] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:12.877175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65896-14f2-4272-be4f-aa5134ddc318 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:12.877654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65896-14f2-4272-be4f-aa5134ddc318 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:12.877746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65896-14f2-4272-be4f-aa5134ddc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:12.897572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6ae65896-14f2-4272-be4f-aa5134ddc318 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:12.898757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6ae65896-14f2-4272-be4f-aa5134ddc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:12.933683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:12.966406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 541/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:13.236459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478739e-ae81-4d63-83c5-1b1516c9fcfc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.277467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:13.337839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478739e-ae81-4d63-83c5-1b1516c9fcfc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.353459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517015-eac6-4ba5-b411-4ae55566b840 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.353769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517015-eac6-4ba5-b411-4ae55566b840 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.354042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517015-eac6-4ba5-b411-4ae55566b840 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.357535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 542/1087] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:13.360890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.361176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.361451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.371971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:13.372590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.372864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.373133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.378928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:13.380115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:13.382995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:13.387691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:13.388583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:13.389815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 546/1088] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:13.394529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.447996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 543/1089] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:48:13.489576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:13.494251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d59b-4432-478f-9728-76fbdc3cea90 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.528685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:13.529289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.529609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.529883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.531252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:13.531530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:13.532916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:13.540598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 547/1090] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:13.546610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.643480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d50e0-1108-48b4-9b29-bc6833b25055 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.644955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:13.679009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:13.679628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.679908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.680184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.690255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:13.691686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:13.706409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:13.707519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:13.708395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:13.708395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:13.708395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:13.708395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 544/1091] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:13.713413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.723984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.817582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c47a7-3075-483b-8700-b09888a70a38 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.827026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2817-e943-4db9-9e80-9aa9437f9c4d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.850529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:13.851130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.851434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.851705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.852343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:13.852643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:13.854033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:13.860781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:13.861409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:13.861712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:13.861979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:13.865953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 548/1092] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:13.871625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.876398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:13.881253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:13.882616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:13.883457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 545/1093] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:13.888145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:13.893700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:13.904549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:13.981696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7dc7-d522-421d-9001-bda4d9a97435 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:13.990758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a70b7-feed-407d-8eb1-7dcbf7a4de40 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.016757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.017373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.017673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.017943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.024515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.024647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.025113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.025393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.025705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.026066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.026370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:14.026679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.028026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.037463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 546/1094] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:48:14.037634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:14.038498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:14.039430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 549/1095] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 12:48:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:14.043793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.044175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.120765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.127617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.144452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6b60-e434-47dd-b182-883c246a1fa4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.146071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13556a-4e6c-4da6-bd9b-8f8d814df9d7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.178647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.178974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.179263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.179537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.179630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.179803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] PATH_INFO: `/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.179893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.180081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.180799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:14.180909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ec0c5fb4804b59bdce2f8893bb4a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.181100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.182336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.182526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.183898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 547/1096] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/users/e3ec0c5fb4804b59bdce2f8893bb4a24 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:14.189867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.199850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 550/1097] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:14.205431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.300925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086fdf-2077-485e-9498-68acd9363260 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.307732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbcce-e9fa-4ae0-b992-ae0bf2b386a9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.335767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.336369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.336647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.336918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.344657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.345260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.345581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.345854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.352075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.354677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.405967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.408419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.414091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.415523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.506913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 548/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:48:14.512624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.520828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 551/1099] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:48:14.521843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.558025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.567648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.619362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920337-3b2f-4276-8cbd-21e3afe9aeb9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.629104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be331-1c24-43f2-b73c-43aea200913e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.655130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.655763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.656110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.656405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.657587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.659022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.660801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 549/1100] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:14.662582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.663197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.663472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.663742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.666638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.674183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.675605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:14.691746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:14.692888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:48:14.693910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:14.693910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:48:14.693910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:14.693910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 552/1101] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:48:14.699222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.766705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6d84-2423-4935-9195-fe421924f282 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.779312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.789329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:14.800369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccbc04-3f31-40bf-9d47-79eea20c84e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:14.803984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.804581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.804856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.805123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.805878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=6dbc866e5ace48b68f69fc43211df719, user.id=e3ec0c5fb4804b59bdce2f8893bb4a24) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:14.806182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.807996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.814945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 550/1102] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/role_assignments?user.id=e3ec0c5fb4804b59bdce2f8893bb4a24&scope.project.id=6dbc866e5ace48b68f69fc43211df719&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:14.835815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:14.836444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:14.836724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:14.836998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:14.837704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:14.838012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:14.839423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:14.858726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 553/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:14.860905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:14.968144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b203f70-c58e-49a9-81ee-6d331e54614f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:15.004359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:15.005000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:15.005281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:15.005586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:15.012706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:15.014298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:48:15.025764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:15.026677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:15.027555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 551/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:15.032877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:15.133803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c6fc-7109-4630-a02a-8f00413da3e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:15.168104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:15.168708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:15.168984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:15.169254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:15.169970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:15.170275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:15.172783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b05b9-bc3e-4dc2-92df-1e80f4a64d8f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:15.184121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 554/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:15.191020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:15.226704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:15.294943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0c520-4360-45bf-a3d7-20260f64e6da None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:15.329758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:15.330353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:15.330633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:15.330906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:15.331633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] RBAC: Adding query filter params (role.id=04c305da2ad7457cb733d92d4706c785, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:15.331939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:15.333365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab92ee-a063-4231-88da-72db154503e5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:15.339050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 552/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:15 2022] GET /identity/v3/role_assignments?user.id=e4e7f0ac2d354e1eac91ab2b91e5a89b&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=04c305da2ad7457cb733d92d4706c785 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:16.748268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792eb4-96e8-435c-be7c-29f8d2d67f7c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:16.748803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792eb4-96e8-435c-be7c-29f8d2d67f7c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:16.748803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792eb4-96e8-435c-be7c-29f8d2d67f7c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:16.751329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 555/1107] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:16.756317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:16.756735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:16.756888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:16.774469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:16.775623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:16.839271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 553/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:17.113066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f792eb4-96e8-435c-be7c-29f8d2d67f7c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:17.126649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:17.213139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f792eb4-96e8-435c-be7c-29f8d2d67f7c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:17.245129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:17.245761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:17.246038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:17.246306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:17.247397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:17.248794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4b65b-6f88-45b7-ace7-e1f6f36bf17e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:17.251240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 556/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:17.256841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:17.285391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:17.352068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ef744-92c4-46dd-93af-cca7347a51d0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:17.385719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:17.386253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:17.386530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:17.386801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:17.387442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:17.388861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fc14a-1ec5-4f28-8531-25fb9e5f373b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:17.410685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 554/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:48:17 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:19.364174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8d33-732c-47d5-a676-5428a8f31e5f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:19.364733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8d33-732c-47d5-a676-5428a8f31e5f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:19.364733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8d33-732c-47d5-a676-5428a8f31e5f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:19.366015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 557/1111] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:19.371417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:19.371809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:19.371962 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:19.390035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:19.391805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:19.455332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:19.719137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f8d33-732c-47d5-a676-5428a8f31e5f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:19.795945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:19.818683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f8d33-732c-47d5-a676-5428a8f31e5f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:19.850300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:19.850903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:19.851177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:19.851446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] PATH_INFO: `/v3/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:19.852799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] RBAC: Authorizing `identity:get_role(role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:19.854171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:19.855618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 558/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:19 2022] GET /identity/v3/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:19.861970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:19.878657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:19.958141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62e4c0-f3ab-4301-b826-6fe6c0cff16a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:19.993923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:19.994476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:19.994750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:19.995016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] PATH_INFO: `/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:20.007831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c2cccad8c4f90850b275d6a7f22e9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:20.009255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:20.010852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 556/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:19 2022] GET /identity/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:20.016685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:20.116406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ea6ba-8f99-46c0-b737-348b35bfd7bd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:20.148163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:20.148753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:20.149026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:20.149295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:20.164960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:20.215573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:20.216988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:20.309942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:20.316206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:20.389173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:20.414610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ceb58-3f99-4519-95d3-af32ac9fce87 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:20.446557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:20.447166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:20.447439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:20.447707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:20.448799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:20.450227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52630054-0854-485a-be08-b0cac5e8080e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:20.451813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 557/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:20 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:20.458449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:20.502238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:20.553887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f5674-978f-472e-99da-a56dd375a090 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:20.586072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:20.586660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:20.586934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:20.587202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:20.587918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=6dbc866e5ace48b68f69fc43211df719, user.id=ec3c2cccad8c4f90850b275d6a7f22e9) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:20.588217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:20.589640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a4fe-22f2-47f2-971e-c94100162712 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:20.595325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 560/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:20 2022] GET /identity/v3/role_assignments?user.id=ec3c2cccad8c4f90850b275d6a7f22e9&scope.project.id=6dbc866e5ace48b68f69fc43211df719&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:22.481237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b01f4-cb2d-4293-972f-30b1cc2e92ee None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:22.481772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b01f4-cb2d-4293-972f-30b1cc2e92ee None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:22.481772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b01f4-cb2d-4293-972f-30b1cc2e92ee None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:22.483064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 558/1118] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:22.488644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:22.489070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:22.489204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:22.507732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:22.508899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:22.573815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:22.842956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b01f4-cb2d-4293-972f-30b1cc2e92ee None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:22.943745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b01f4-cb2d-4293-972f-30b1cc2e92ee None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:22.986556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:22.987181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:22.987465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:22.987740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] PATH_INFO: `/v3/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:22.989138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] RBAC: Authorizing `identity:get_role(role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:22.990526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:22.991838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 559/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:22 2022] GET /identity/v3/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:22.997854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:23.037715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:23.094373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06e03-86f0-4b2d-8726-9da1ea7c56a6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:23.127909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:23.128519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:23.128793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:23.129061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] PATH_INFO: `/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:23.130181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c2cccad8c4f90850b275d6a7f22e9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:23.131585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:23.133130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 562/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:22 2022] GET /identity/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:23.138895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:23.151551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:23.243992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c172f-bd5e-48fe-a79c-370fa5b3162f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:23.276275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:23.276914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:23.277188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:23.277455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:23.278574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:23.280015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59509-0181-4e0d-8131-e4615ee0c67c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:23.281714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 560/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:23 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:23.287657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:23.384449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f697-15df-43ca-8f2c-eaf1b4d53255 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:23.393760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:23.418205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:23.418837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:23.419110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:23.419379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719/users/ec3c2cccad8c4f90850b275d6a7f22e9/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:23.421517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbc866e5ace48b68f69fc43211df719, user_id=ec3c2cccad8c4f90850b275d6a7f22e9, role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:23.422922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a0b74-dae1-4b67-a0a9-633d4c8e855b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:23.434459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 563/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:48:23 2022] PUT /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719/users/ec3c2cccad8c4f90850b275d6a7f22e9/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:48:25.336824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f37b85-059b-4858-b9ae-c33b003bc497 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:25.337371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f37b85-059b-4858-b9ae-c33b003bc497 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:25.337371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f37b85-059b-4858-b9ae-c33b003bc497 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:25.338721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 561/1124] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:25.344559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:25.344978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:25.345082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:25.363590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:25.364727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:25.429554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 564/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:25.696313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f37b85-059b-4858-b9ae-c33b003bc497 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:25.775202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:25.798568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f37b85-059b-4858-b9ae-c33b003bc497 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:25.831976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:25.832580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:25.832858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:25.833131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] PATH_INFO: `/v3/roles/69fb853b5f92419caf40a673f7fa75e6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:25.834528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] RBAC: Authorizing `identity:get_role(role_id=69fb853b5f92419caf40a673f7fa75e6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:25.835876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:25.837167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 562/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:25 2022] GET /identity/v3/roles/69fb853b5f92419caf40a673f7fa75e6 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:25.844110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:25.934435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:25.938756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e7526-5f62-4ce4-a679-47fff02651cd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:25.971936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:25.972482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:25.972756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:25.973024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] PATH_INFO: `/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:25.974222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c2cccad8c4f90850b275d6a7f22e9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:25.975638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:25.977210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 565/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:25 2022] GET /identity/v3/users/ec3c2cccad8c4f90850b275d6a7f22e9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:25.982966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:26.080222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2b59-1c37-4dbc-a48b-f56d7134fccd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:26.112982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:26.113610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:26.113887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:26.114153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:26.129805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:26.179596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:26.181026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:26.273887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 563/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:26.279745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:26.377496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a335-73ff-4115-94de-f64098e12864 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:26.410253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:26.410869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:26.411146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:26.411421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] PATH_INFO: `/v3/projects/6dbc866e5ace48b68f69fc43211df719` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:26.412519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbc866e5ace48b68f69fc43211df719)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:26.413968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207e07e-e030-47c6-9ab7-c2e4e3766e28 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:26.415568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 566/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:26 2022] GET /identity/v3/projects/6dbc866e5ace48b68f69fc43211df719 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:48:26.422851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:26.468130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:26.519586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb940-c096-4254-bac1-dbcbe969bdf7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:26.552201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:26.552796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:26.553069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:26.553335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:26.554078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] RBAC: Adding query filter params (role.id=69fb853b5f92419caf40a673f7fa75e6, scope.project.id=6dbc866e5ace48b68f69fc43211df719, user.id=ec3c2cccad8c4f90850b275d6a7f22e9) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:26.554380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:26.555788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d8adb-4bec-4f2c-bcb2-da64ae0b0c07 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:26.561292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 564/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:26 2022] GET /identity/v3/role_assignments?user.id=ec3c2cccad8c4f90850b275d6a7f22e9&scope.project.id=6dbc866e5ace48b68f69fc43211df719&role.id=69fb853b5f92419caf40a673f7fa75e6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:28.462205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644aaae-0469-4115-9b7b-b56b3a7b6bbb None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:28.462778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644aaae-0469-4115-9b7b-b56b3a7b6bbb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:28.462778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644aaae-0469-4115-9b7b-b56b3a7b6bbb None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:28.463972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 567/1131] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:28.469826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:28.470295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:28.470392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:28.488259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:28.489446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:28.553094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 565/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:28.833377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644aaae-0469-4115-9b7b-b56b3a7b6bbb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:28.868505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:28.933260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644aaae-0469-4115-9b7b-b56b3a7b6bbb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:28.966167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:28.966772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:28.967047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:28.967311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:28.968595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:28.970032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fcb34-f97a-4923-be9d-0bc905ec8b16 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:28.971557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 568/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:28.977449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:29.018183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:29.073919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44cb4e-54cb-4120-ba87-16bf30345cda None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:29.106889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:29.107495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:29.107772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:29.108040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:29.108714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:29.110167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42ad35-5b0a-4d77-976d-90cce58f7749 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:29.136180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 566/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:48:28 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:31.062607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ef68-2301-4277-a969-ee25bd932455 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:31.063141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ef68-2301-4277-a969-ee25bd932455 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:31.063141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ef68-2301-4277-a969-ee25bd932455 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:31.064449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 569/1135] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:31.069689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:31.070134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:31.070235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:31.088514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:31.089724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:31.156334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 567/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:31.433769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ef68-2301-4277-a969-ee25bd932455 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:31.533644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ef68-2301-4277-a969-ee25bd932455 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:31.535117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:31.568331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:31.568969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:31.569243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:31.569535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:31.570629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:31.572031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8074f-b997-4ea5-b0eb-366f40f7e63a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:31.573580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 570/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:48:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:31.579273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:31.601903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:31.676794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67f8f-ba8a-40a1-888e-ea82e24d9182 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:31.710040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:31.710566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:31.710841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:31.711107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:31.711740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:31.713142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a6a4-e413-488a-b02a-c9768e1070df None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:31.733846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 568/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:48:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:33.689382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fb1a2-e848-4cde-bdb6-f317f2915372 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:33.689954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fb1a2-e848-4cde-bdb6-f317f2915372 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:33.689954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fb1a2-e848-4cde-bdb6-f317f2915372 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:33.691264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 571/1139] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:33.696467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:33.696875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:33.697016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:33.715918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:33.717099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:33.783067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:34.062494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fb1a2-e848-4cde-bdb6-f317f2915372 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:34.162441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fb1a2-e848-4cde-bdb6-f317f2915372 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:34.195572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:34.196182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:34.196461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:34.196737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:34.207094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:34.211880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:34.213027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:34.214055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 572/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:34.219028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:34.228783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:34.316048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e4012-b31d-4819-acae-e65ccd87f592 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:34.348398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:34.348988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:34.349262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:34.349552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:34.350203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:34.350498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:34.351838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:34.359537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 570/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:34.365237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:34.396403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:34.463351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c873-82d1-40f7-b638-67cd111aee7c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:34.496461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:34.497070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:34.497343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:34.497653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] PATH_INFO: `/v3/users/74a120c81cb346cdab6d2bb33ccaf19e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:34.510833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] RBAC: Authorizing `identity:get_user(user_id=74a120c81cb346cdab6d2bb33ccaf19e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:34.512248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:34.513833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 573/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/users/74a120c81cb346cdab6d2bb33ccaf19e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:34.519767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:34.585941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:34.617117 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fce2-a795-448e-84c2-3d5ce6629574 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:34.650330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:34.650926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:34.651205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:34.651476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:34.716496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:34.718015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:34.782562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:34.813783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 571/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:34.819689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:34.904836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:34.918071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94935624-2e58-4e18-ab66-3c2c2fd2fb1b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:34.951228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:34.951855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:34.952692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:34.952968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] PATH_INFO: `/v3/projects/979a157d32734a80915d8721cf713eb0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:34.954089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] RBAC: Authorizing `identity:get_project(project_id=979a157d32734a80915d8721cf713eb0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:34.955511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e0b5c-5159-40a2-9fbb-d83e3b7e1444 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:34.957125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 574/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/projects/979a157d32734a80915d8721cf713eb0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:34.963367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:35.061663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfd680-f367-472f-b267-85e96f0e2e73 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:35.094302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:35.094902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:35.095178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:35.095451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:35.096175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=979a157d32734a80915d8721cf713eb0, user.id=74a120c81cb346cdab6d2bb33ccaf19e) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:35.096482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:35.097937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053022-feb2-4711-96d0-1cebbaf5b0c0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:35.103412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 572/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:34 2022] GET /identity/v3/role_assignments?user.id=74a120c81cb346cdab6d2bb33ccaf19e&scope.project.id=979a157d32734a80915d8721cf713eb0&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:36.986535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf342-085e-4da9-9b40-842427334223 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:36.987100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf342-085e-4da9-9b40-842427334223 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:36.987100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf342-085e-4da9-9b40-842427334223 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:36.988437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 575/1147] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:36.993986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:36.994411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:36.994518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:37.013734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:37.014925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:37.040023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:37.081505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 573/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:37.347592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf342-085e-4da9-9b40-842427334223 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:37.448775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf342-085e-4da9-9b40-842427334223 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:37.482142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:37.482756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:37.483066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:37.483341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:37.493178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:37.498013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:37.499091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:37.499983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 576/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:37.505365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:37.601233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcebd35-0d1d-4a7d-b3c6-9e428b1ab815 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:37.633246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:37.633859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:37.634133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:37.634398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:37.635048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:37.635350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:37.636687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:37.644869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 574/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:37.650566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:37.669380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:37.753005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471620-6034-499f-8a51-c99a064e210a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:37.791081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:37.791695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:37.791973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:37.792242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] PATH_INFO: `/v3/users/74a120c81cb346cdab6d2bb33ccaf19e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:37.793631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] RBAC: Authorizing `identity:get_user(user_id=74a120c81cb346cdab6d2bb33ccaf19e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:37.795045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:37.797070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 577/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:37 2022] GET /identity/v3/users/74a120c81cb346cdab6d2bb33ccaf19e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:37.803014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:37.830414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:37.900766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0975d-3c41-40db-b101-5d5026bba583 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:37.932796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:37.933415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:37.933728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:37.934003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] PATH_INFO: `/v3/projects/979a157d32734a80915d8721cf713eb0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:37.935127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] RBAC: Authorizing `identity:get_project(project_id=979a157d32734a80915d8721cf713eb0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:37.938090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700530e-7867-4bec-bab1-793bca13863c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:37.939713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 575/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:37 2022] GET /identity/v3/projects/979a157d32734a80915d8721cf713eb0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:37.945729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:38.026744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:38.042945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48697f-861a-4761-8ce5-69284e186933 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:38.077304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:38.078494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:38.078772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:38.079050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] PATH_INFO: `/v3/projects/979a157d32734a80915d8721cf713eb0/users/74a120c81cb346cdab6d2bb33ccaf19e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:38.081002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] RBAC: Authorizing `identity:create_grant(project_id=979a157d32734a80915d8721cf713eb0, user_id=74a120c81cb346cdab6d2bb33ccaf19e, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:38.082454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6651d7-d458-479a-90f4-9d31de9afc78 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:38.097325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 578/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:48:37 2022] PUT /identity/v3/projects/979a157d32734a80915d8721cf713eb0/users/74a120c81cb346cdab6d2bb33ccaf19e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:48:39.955834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc99d7-3c93-44ca-90cb-176c2a7c3d8f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:39.956408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc99d7-3c93-44ca-90cb-176c2a7c3d8f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:39.956408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc99d7-3c93-44ca-90cb-176c2a7c3d8f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:39.957723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 576/1154] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:39.962773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:39.963156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:39.963331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:39.982787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:39.983970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:40.047584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 579/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:40.317882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc99d7-3c93-44ca-90cb-176c2a7c3d8f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:40.409393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:40.417156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc99d7-3c93-44ca-90cb-176c2a7c3d8f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:40.449838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:40.450798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:40.451226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:40.452166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:40.463151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:40.468634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:40.469767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:40.470658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 577/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:40.475944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:40.547496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:40.571951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14b5b-b025-4d6f-9fed-fa7a88d9df6d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:40.604758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:40.605342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:40.605647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:40.605918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:40.606572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:40.606870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:40.608261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:40.615933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 580/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:40.621785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:40.725839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec99f1-bb33-4544-8be1-49a75d9e2ac7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:40.758920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:40.759535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:40.759812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:40.760084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] PATH_INFO: `/v3/users/74a120c81cb346cdab6d2bb33ccaf19e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:40.761187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] RBAC: Authorizing `identity:get_user(user_id=74a120c81cb346cdab6d2bb33ccaf19e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:40.762644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:40.764785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 578/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:40 2022] GET /identity/v3/users/74a120c81cb346cdab6d2bb33ccaf19e => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:40.770789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:40.867301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15de4f-676b-436b-b485-41f4d1367408 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:40.900072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:40.900663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:40.900938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:40.901210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:40.904489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:40.966188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:40.967802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:41.062151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 581/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:41.068103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:41.092457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:41.168756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2b9d-bf01-4e46-9eea-33c3f7d7d496 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:41.203616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:41.204236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:41.204512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:41.204781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] PATH_INFO: `/v3/projects/979a157d32734a80915d8721cf713eb0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:41.205908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] RBAC: Authorizing `identity:get_project(project_id=979a157d32734a80915d8721cf713eb0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:41.207329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e3322-25d0-4236-b9b6-81d980fcc826 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:41.208927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 579/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:41 2022] GET /identity/v3/projects/979a157d32734a80915d8721cf713eb0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:41.215081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:41.248150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:41.314837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e04a-664f-4975-8ecc-860d271f1fea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:41.347538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:41.348131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:41.348410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:41.348684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:41.349405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=979a157d32734a80915d8721cf713eb0, user.id=74a120c81cb346cdab6d2bb33ccaf19e) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:41.349744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:41.351162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52affb-1ae1-482b-a8d8-69331444addd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:41.356736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 582/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:41 2022] GET /identity/v3/role_assignments?user.id=74a120c81cb346cdab6d2bb33ccaf19e&scope.project.id=979a157d32734a80915d8721cf713eb0&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:43.265586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1681b7-167c-4949-af0f-b7f29274a301 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:43.266106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1681b7-167c-4949-af0f-b7f29274a301 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:43.266106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1681b7-167c-4949-af0f-b7f29274a301 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:43.267448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 580/1162] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:43.272516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:43.272933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:43.273066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:43.291285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:43.292714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:43.360178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 583/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:43.625535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1681b7-167c-4949-af0f-b7f29274a301 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:43.713951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:43.724754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1681b7-167c-4949-af0f-b7f29274a301 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:43.756847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:43.757437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:43.757740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:43.758011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:43.822571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:43.824001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:43.908997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:43.919300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 581/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:43.925175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:43.954518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:44.021803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553fa87-e0e6-4e44-9655-81f63b8f0a61 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:44.053821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:44.054432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:44.054707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:44.054977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:44.061889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:44.063294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-30b9e6c2-5f58-489e-95c3-0a8b1434e6b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:44.074322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:44.075520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:48:44.077019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 584/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:48:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:44.081890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:44.179366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2a190-79bb-45e2-89e2-4ff8e9b09e69 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:44.212304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:44.212898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:44.213176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:44.213448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:44.214113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:44.214415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:44.215976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbe3f-1103-4dd5-994a-ab0a902362be None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:44.223468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 582/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 12:48:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:46.161503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27e6b-7809-4159-af7d-828061275b8a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:46.162025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27e6b-7809-4159-af7d-828061275b8a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:46.162116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27e6b-7809-4159-af7d-828061275b8a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:46.163390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 585/1167] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:46.168854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf63ec-4519-4b91-ba9d-22695e2ea6cb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:46.169251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf63ec-4519-4b91-ba9d-22695e2ea6cb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:46.169403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf63ec-4519-4b91-ba9d-22695e2ea6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:46.187904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-77cf63ec-4519-4b91-ba9d-22695e2ea6cb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:46.189075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-77cf63ec-4519-4b91-ba9d-22695e2ea6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:46.237415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:46.254516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:46.529396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27e6b-7809-4159-af7d-828061275b8a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:46.618567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:46.629748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27e6b-7809-4159-af7d-828061275b8a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:46.662238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:46.662829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:46.663107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:46.663380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:46.664055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:46.665403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410acc7-f225-4e6b-9063-0330d187e4cf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:46.682205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 586/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Aug 31 12:48:46 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:48.612277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3478b-817d-4191-81a7-bf7509691496 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:48.612789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3478b-817d-4191-81a7-bf7509691496 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:48.612883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3478b-817d-4191-81a7-bf7509691496 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:48.614176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 584/1170] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:48.619233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20963-e197-41cf-a763-3c390da92195 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:48.619651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20963-e197-41cf-a763-3c390da92195 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:48.619792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20963-e197-41cf-a763-3c390da92195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:48.637652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-54c20963-e197-41cf-a763-3c390da92195 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:48.638840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-54c20963-e197-41cf-a763-3c390da92195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:48.704605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 587/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:48.989877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3478b-817d-4191-81a7-bf7509691496 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:49.088393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3478b-817d-4191-81a7-bf7509691496 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:49.123838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:49.124467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:49.124747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:49.125016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] PATH_INFO: `/v3/domains/a4da4fa4d4ff40f5a5bdfd98d2cd0e28` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:49.135218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a4da4fa4d4ff40f5a5bdfd98d2cd0e28)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:49.136648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a66aa-9282-4829-b165-c07ab9bbf5d3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:49.138260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 585/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 31 12:48:48 2022] GET /identity/v3/domains/a4da4fa4d4ff40f5a5bdfd98d2cd0e28 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:49.144737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c20963-e197-41cf-a763-3c390da92195 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:49.221276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:49.240221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c20963-e197-41cf-a763-3c390da92195 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:49.273462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:49.274082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:49.274359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:49.274625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:49.275269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:49.276675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f31d-a7cb-4159-9ae6-d149c9039725 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:49.303274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 588/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:48:49 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:48:51.221507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dbf2e-f3ff-4491-a6ad-3a2e89d6f115 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:51.222038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dbf2e-f3ff-4491-a6ad-3a2e89d6f115 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:51.222038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dbf2e-f3ff-4491-a6ad-3a2e89d6f115 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:51.223400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 586/1174] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:51.228523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:51.228934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:51.229052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:51.247484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:51.249246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:51.313824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 589/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:51.590253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dbf2e-f3ff-4491-a6ad-3a2e89d6f115 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:51.636458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:51.690084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dbf2e-f3ff-4491-a6ad-3a2e89d6f115 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:51.723093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:51.723700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:51.723974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:51.724243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] PATH_INFO: `/v3/domains/a4da4fa4d4ff40f5a5bdfd98d2cd0e28` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:51.725330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a4da4fa4d4ff40f5a5bdfd98d2cd0e28)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:51.726769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0174d9-3334-4887-8b74-7bdbbb612877 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:51.728293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 587/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 31 12:48:51 2022] GET /identity/v3/domains/a4da4fa4d4ff40f5a5bdfd98d2cd0e28 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:51.734250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:51.793645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:51.830774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c8c3-1ba9-4cda-9565-b59a9599f973 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:51.863376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:51.863909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:51.864186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:51.864456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:51.865094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:51.866530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51791f5b-4e7d-4ebc-817b-c1f3799f3eee None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:51.887463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 590/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:48:51 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:48:53.795955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01885-ef0f-4372-a96d-d7fa5dcf5bd4 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:53.796526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01885-ef0f-4372-a96d-d7fa5dcf5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:53.796526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba01885-ef0f-4372-a96d-d7fa5dcf5bd4 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:53.797838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 588/1178] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:53.802974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:53.803414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:53.803508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:53.821748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:53.822922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:53.887069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 591/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:54.154597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba01885-ef0f-4372-a96d-d7fa5dcf5bd4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:54.253648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba01885-ef0f-4372-a96d-d7fa5dcf5bd4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:54.266584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:54.287703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:54.288318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:54.288593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:54.288865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:54.299878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:54.304650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:54.305837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:54.306923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 589/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:54.312440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:54.359861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:54.408575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5c35-2513-4b59-b015-5af65fa6d2f0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:54.440907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:54.441515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:54.441858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:54.442126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:54.442778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:54.443074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:54.444409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:54.452129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 592/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:54.457948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:54.558014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27347de9-1062-41f0-a0e2-702a66e8f0cb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:54.592876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:54.593594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:54.593937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:54.594249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] PATH_INFO: `/v3/users/76985a3a1f5a476682cb821996960f68` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:54.606940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] RBAC: Authorizing `identity:get_user(user_id=76985a3a1f5a476682cb821996960f68)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:54.610364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:54.618336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 590/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:54 2022] GET /identity/v3/users/76985a3a1f5a476682cb821996960f68 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:54.619375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:54.721287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ccc9-4318-47ed-b85a-eba1bc7bfa8e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:54.731176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:54.754780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:54.755374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:54.755649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:54.755920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:54.822343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:54.823703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:54.919696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 593/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:48:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:48:54.925761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:54.955654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:55.022323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb431a8-89fa-4a2b-b12c-7d2ee5d049ae None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:55.055494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:55.056110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:55.056382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:55.056651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] PATH_INFO: `/v3/projects/0f9aeddf3b6a43b188200e2416f91901` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:55.057786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] RBAC: Authorizing `identity:get_project(project_id=0f9aeddf3b6a43b188200e2416f91901)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:55.060204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f6d00-4386-4c67-b99f-518940e714c0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:55.062480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 591/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:54 2022] GET /identity/v3/projects/0f9aeddf3b6a43b188200e2416f91901 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:55.068575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:55.080114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:55.166761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752eb5-ac94-488d-9c60-0f38f7a9cb20 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:55.201463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:55.202018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:55.202299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:55.202571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:55.203294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=0f9aeddf3b6a43b188200e2416f91901, user.id=76985a3a1f5a476682cb821996960f68) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:55.203603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:55.205011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50645caf-de95-4444-8c2c-9a8bf881ed7f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:55.210306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 594/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:48:55 2022] GET /identity/v3/role_assignments?user.id=76985a3a1f5a476682cb821996960f68&scope.project.id=0f9aeddf3b6a43b188200e2416f91901&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:57.159741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c6e5-ced4-4339-ab3d-c4b1b0c1d771 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:57.160271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c6e5-ced4-4339-ab3d-c4b1b0c1d771 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:57.160271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c6e5-ced4-4339-ab3d-c4b1b0c1d771 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:57.161719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 592/1186] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:48:57.166922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:57.167572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:57.167724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:57.186921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:48:57.188107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:48:57.254374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 595/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:48:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:48:57.527710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c6e5-ced4-4339-ab3d-c4b1b0c1d771 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:57.624446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:57.629229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c6e5-ced4-4339-ab3d-c4b1b0c1d771 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:57.662083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:57.662697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:57.662973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:57.663243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:57.673965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:48:57.678762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:48:57.679864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:48:57.681129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 593/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:48:57.686359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:57.689401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:57.782671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2a1e-e3d6-4b2b-8e8c-7a52d9f6726c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:57.816424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:57.817013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:57.817291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:57.817590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:57.818255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:48:57.818558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:57.819907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:57.827819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 596/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:57.833706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:57.929706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ae95-0ff6-44d2-b8cd-aeb0899acc7e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:57.962347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:57.962953 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:57.963225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:57.963490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] PATH_INFO: `/v3/users/76985a3a1f5a476682cb821996960f68` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:57.964591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] RBAC: Authorizing `identity:get_user(user_id=76985a3a1f5a476682cb821996960f68)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:57.966034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:57.967767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 594/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:48:57 2022] GET /identity/v3/users/76985a3a1f5a476682cb821996960f68 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:57.973731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:58.036955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:58.071813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5432d-3bea-46ae-84ca-308020ec3d47 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:58.104490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:58.105108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:58.105382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:58.105676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] PATH_INFO: `/v3/projects/0f9aeddf3b6a43b188200e2416f91901` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:58.106793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] RBAC: Authorizing `identity:get_project(project_id=0f9aeddf3b6a43b188200e2416f91901)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:58.108822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd00ff-4ff6-4071-8509-a220d9b6bb1f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:58.110470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 597/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:48:57 2022] GET /identity/v3/projects/0f9aeddf3b6a43b188200e2416f91901 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:48:58.116357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:48:58.142690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:48:58.211587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e750ff-be2e-4583-b30e-7f318462b41b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:48:58.244802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:48:58.245446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:48:58.245743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:48:58.246014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] PATH_INFO: `/v3/projects/0f9aeddf3b6a43b188200e2416f91901/users/76985a3a1f5a476682cb821996960f68/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:48:58.247989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f9aeddf3b6a43b188200e2416f91901, user_id=76985a3a1f5a476682cb821996960f68, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:48:58.249604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96900601-c860-4cf2-b6fb-7de364ec3d53 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:48:58.262966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 595/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:48:58 2022] PUT /identity/v3/projects/0f9aeddf3b6a43b188200e2416f91901/users/76985a3a1f5a476682cb821996960f68/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:49:00.183368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb747-74f9-45c9-ad62-05e0dacf3a38 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:00.183906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb747-74f9-45c9-ad62-05e0dacf3a38 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:00.183906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb747-74f9-45c9-ad62-05e0dacf3a38 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:00.186125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 598/1193] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:49:00.191159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:00.191563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:00.191680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:00.209655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:49:00.210814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:49:00.275614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 596/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:49:00.552884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb747-74f9-45c9-ad62-05e0dacf3a38 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:00.650643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb747-74f9-45c9-ad62-05e0dacf3a38 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:00.684074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:00.684693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:00.685514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:00.685795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:00.687642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:00.696787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:49:00.702341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:49:00.703485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:49:00.704341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 599/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:49:00.709635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:00.726591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:00.807147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571f7c-400d-40bb-a696-0485bdd7685c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:00.839772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:00.840366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:00.840642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:00.840912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:00.841665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:49:00.842104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:00.843473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:00.851171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 597/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:49:00.857570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:00.952695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1994f3-d217-437a-9ec9-f689b9a45b24 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:00.985531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:00.986152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:00.986431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:00.986706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] PATH_INFO: `/v3/users/76985a3a1f5a476682cb821996960f68` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:00.987804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] RBAC: Authorizing `identity:get_user(user_id=76985a3a1f5a476682cb821996960f68)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:00.989268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:00.990862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 600/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 12:49:00 2022] GET /identity/v3/users/76985a3a1f5a476682cb821996960f68 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:49:00.996937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:01.074535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:01.096231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaf965-fb5c-4c8f-a13d-c7bb4a235da1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:01.129903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:01.130507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:01.130789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:01.131061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:01.195941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:01.197385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:01.274369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:01.297729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 598/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:49:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:49:01.303835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:01.364418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:01.401424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cf96-b0c2-4a4a-98c9-672b76dfb189 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:01.436360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:01.436971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:01.437252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:01.437551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] PATH_INFO: `/v3/projects/0f9aeddf3b6a43b188200e2416f91901` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:01.438657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] RBAC: Authorizing `identity:get_project(project_id=0f9aeddf3b6a43b188200e2416f91901)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:01.440068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a907124-eec2-4752-ab71-dd2eae118943 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:01.441705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 601/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 12:49:01 2022] GET /identity/v3/projects/0f9aeddf3b6a43b188200e2416f91901 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:49:01.447812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:01.550577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f39be-55be-4227-915e-ff30aaf7039b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:01.589209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:01.589833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:01.590107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:01.590379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:01.591095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=0f9aeddf3b6a43b188200e2416f91901, user.id=76985a3a1f5a476682cb821996960f68) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:49:01.591713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:01.593139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb28e15-c777-4519-bb93-2549693689bd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:01.605869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 599/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:49:01 2022] GET /identity/v3/role_assignments?user.id=76985a3a1f5a476682cb821996960f68&scope.project.id=0f9aeddf3b6a43b188200e2416f91901&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:49:11.431497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=35 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:11.596240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=79 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:56.944322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c324-6fe1-4043-8847-e396918bd7da None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:56.944946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c324-6fe1-4043-8847-e396918bd7da None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:56.944946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7c324-6fe1-4043-8847-e396918bd7da None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:56.946899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 602/1201] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:49:56.953209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:56.953763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:56.953763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:56.978411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:49:56.980053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:49:57.057024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 600/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:49:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:49:57.334934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7c324-6fe1-4043-8847-e396918bd7da None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:57.497537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7c324-6fe1-4043-8847-e396918bd7da None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:57.544842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:57.545719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:57.545977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:57.546243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:57.561098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:57.563070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:49:57.581140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:49:57.583018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:49:57.584008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:49:57.584008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:49:57.584008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:49:57.584008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 603/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:49:57.588558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:57.736481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791e88-9415-4fbe-ae4b-422d5f0657e2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:57.787698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:57.798502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:57.799277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:57.799576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:57.800715 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:57.801438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:49:57.801791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:57.803230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02743422-0b6f-416a-bca2-1ccdcf5874f2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:57.823875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 601/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:49:57.830373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:49:57.912483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:57.984365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b93112-d3fa-4c99-b75b-4b6b81456883 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:49:58.029463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:49:58.030386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:49:58.030887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:49:58.031342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:49:58.032193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:49:58.034301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c179-0374-42f2-b086-cddd6c626827 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:49:58.062634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 604/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 12:49:57 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:50:00.306856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e96-a26f-4f44-8ebc-ad7e7dd83eb2 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:00.307483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e96-a26f-4f44-8ebc-ad7e7dd83eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:00.307655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e96-a26f-4f44-8ebc-ad7e7dd83eb2 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:00.308905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 602/1206] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:50:00.315169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:00.315633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:00.315733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:00.337074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:00.338309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:00.421595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 605/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:00.693180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51e96-a26f-4f44-8ebc-ad7e7dd83eb2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:00.812176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51e96-a26f-4f44-8ebc-ad7e7dd83eb2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:00.855703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:00.856377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:00.856709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:00.856963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:00.868704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:00.874190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:00.875188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:00.876063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 603/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:50:00.881737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:00.929104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:00.998473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272e5d0-1886-49c0-b947-d2c9414789c6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.039252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.039922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.040203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.040555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.041652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:01.042537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:01.044027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:01.052722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 606/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:01.059026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:01.116828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:01.177837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1e21-4e14-4211-ba2d-2023671054a2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.219279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.220012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.220307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.220557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.233471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:01.235068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:01.254630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:01.255655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:01.256568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:01.256568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:01.256568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:01.256568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 604/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:01.261909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:01.374328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:01.377201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251575-db07-4201-84b3-1e4ee39ea103 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.414763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.415368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.415650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.415924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.417098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:01.417420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:01.418799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:01.431493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 607/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:01.438260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:01.562386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c58-1787-4859-807f-0b46d3d403ba None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.562770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:01.601368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.602157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.602488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.602797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.613993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:01.616065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:01.629805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:01.631029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:01.632300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:01.633910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 605/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:50:01.640206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:01.744425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5311-8de7-4c55-a8f6-27a81364c6c4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.779924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.780669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.781057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.781439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.782311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:01.782690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:01.784171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:01.804009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 608/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:01.810440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:01.923548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d1c1-372c-455e-a9a7-83f4e7e9920c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:01.962140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:01.963130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:01.963130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:01.963468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:01.998472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:02.047621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:02.049123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:02.170577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 606/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:50:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:50:02.171933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:02.193243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:02.292147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474210-d3f2-44af-860e-f9e3fea924b4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:02.331128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:02.331929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:02.332231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:02.332489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:02.343946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:02.345386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:02.368257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:02.370025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:02.370965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:02.370965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:02.370965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:02.373607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 609/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:02.382894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:02.453448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:02.497742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc8f-4e30-4b9d-90bc-517b8a17f229 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:02.540015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:02.541699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:02.541699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:02.541699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:02.542176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:02.542606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:02.543968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:02.556446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 607/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:02.562658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:02.637794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:02.671284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b251fcf-70d9-4322-9f62-89e830c028cf None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:02.708695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:02.709294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:02.709595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:02.709754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:02.718126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:02.719584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:02.731728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:02.732651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:02.738374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 610/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:02.740698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:02.850365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd3229-7ae8-43b5-b7a4-2ba6cb16fa5d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:02.876579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:02.889825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:02.890434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:02.890709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:02.890977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:02.891727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:02.892275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:02.893708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf6afb-b60e-4c7b-a478-23288f008251 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:02.913198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 608/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:02.914424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:03.032314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd023d5-31b9-491d-8beb-ab7179df928b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:03.062869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:03.069884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:03.071100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:03.071724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:03.072226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:03.074025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=458dde7e70e746ef9a69f0e8afca9602) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:03.074557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:03.076160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a21870-3bee-4040-9314-2e14b9e35ddb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:03.082238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 611/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:50:02 2022] GET /identity/v3/role_assignments?user.id=458dde7e70e746ef9a69f0e8afca9602&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:05.169448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eaa77-1ad7-4603-93cf-4fde0b97f078 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:05.170015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eaa77-1ad7-4603-93cf-4fde0b97f078 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:05.170163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eaa77-1ad7-4603-93cf-4fde0b97f078 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:05.171521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 609/1220] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:05.179102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:05.179552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:05.179647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:05.197994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:05.199183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:05.270615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 612/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:05.564866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eaa77-1ad7-4603-93cf-4fde0b97f078 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:05.673419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eaa77-1ad7-4603-93cf-4fde0b97f078 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:05.707145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:05.707763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:05.708033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:05.708322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:05.719331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:05.724372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:05.725646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:05.726638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 610/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:05.732543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:05.834301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c3663-6aa8-4036-a451-71839706d94e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:05.858396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:05.869146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:05.869838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:05.870170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:05.870391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:05.871053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:05.871352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:05.872700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:05.881360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 613/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:05.887727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:05.938242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:06.003254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a7b2-a67d-4072-8f8d-eca5d0b4938a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.038608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.039313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.039593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.041534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.053867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.055345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:06.070961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:06.072099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:06.073884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:06.073884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:06.073884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:06.073884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 611/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:06.079041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.192316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4438-5ae3-44e1-a306-4f97ed00ae94 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.227855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.228499 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.228874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.229708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.230397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:06.230715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.232223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.245070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 614/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:06.251037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.349665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:06.358109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80e9a-e2e1-49f4-b92a-f9c85e616329 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.393381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.394033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.394307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.394574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.402055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.403613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:06.415606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:06.417396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:06.418561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:06.422459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 612/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:06.423587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.477436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:06.542468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b7764-6f43-47a6-9e2a-ed461b87e26d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.576044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.576653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.576960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.577197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.577950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:06.578265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.579641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.597447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 615/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:06.603160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.707741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af23ef0-74d4-409c-b6d5-660a863c501f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.746865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.747475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.747748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.748010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.758921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.760430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:06.774359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:06.775361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:06.776811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:06.776811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:06.776811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:06.776811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 613/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:06.782242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.899179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e1b9-b1ae-4db5-939e-5868f2cfc22c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:06.902046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:06.939487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:06.940213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:06.940675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:06.940938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:06.941752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:06.942069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:06.943448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:06.956501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 616/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:06.962554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:06.972476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:07.074953 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded16aee-8376-4500-964a-77dac698d1e6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:07.114240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:07.114937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:07.115216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:07.115488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:07.123254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:07.124689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:07.137426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:07.138549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:07.139624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 614/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:07.144560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:07.258718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839363c-a174-472e-a739-dac0ba5aceb4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:07.295404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:07.296058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:07.296280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:07.296552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:07.297237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:07.297566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:07.298974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c136-dae3-4673-9e74-662897ddcb3f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:07.311794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 617/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:07.318068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:07.391362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:07.426882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f4b3-4cae-4ad9-a7d8-18c65040e982 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:07.465249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:07.465949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:07.466304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:07.466619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/458dde7e70e746ef9a69f0e8afca9602/roles/1fe2b898b9794ecaa6228485f327e7be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:07.482658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=458dde7e70e746ef9a69f0e8afca9602, role_id=1fe2b898b9794ecaa6228485f327e7be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:07.484204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd28e5-972e-4cd2-a2de-87200a19f18d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:07.497910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 615/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:50:07 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/458dde7e70e746ef9a69f0e8afca9602/roles/1fe2b898b9794ecaa6228485f327e7be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:50:09.599917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32341-d528-4ec4-9767-daa3a3038bf6 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:09.600780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32341-d528-4ec4-9767-daa3a3038bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:09.600780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32341-d528-4ec4-9767-daa3a3038bf6 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:09.602060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 618/1233] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:09.608830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:09.609338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:09.609456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:09.629746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:09.630927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:09.701159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 616/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:09.996099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32341-d528-4ec4-9767-daa3a3038bf6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.023025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:10.109684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32341-d528-4ec4-9767-daa3a3038bf6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:10.144779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:10.145527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:10.145850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:10.146234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:10.157634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:10.163147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:10.164144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:10.164963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 619/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 12:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:10.171237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.222470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:10.282888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052216-f6a7-4fee-9c63-4ee08e43dad2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:10.318376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:10.319100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:10.319457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:10.319824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:10.320762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:10.321127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:10.323865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:10.332970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 617/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 12:50:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:10.340029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.434851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:10.452796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f785-1fce-43ed-8cb7-fff3b5889759 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:10.488011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:10.488638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:10.488917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:10.489192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:10.502961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:10.505315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:10.523214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:10.524716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:10.525983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:10.525983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:10.525983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:10.525983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 620/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:10.531475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.641720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7b66-59e4-4d6d-9465-df0ce3c0ce8a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:10.652535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:10.679801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:10.680494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:10.680770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:10.681042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:10.681872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:10.682249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:10.683640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:10.698558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 618/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:10.704481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.817012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881331be-e2b1-455b-abf9-7b41c7e8de58 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:10.855578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:10.856203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:10.856476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:10.856743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:10.859482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:10.866643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:10.868519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:10.881241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:10.882255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:10.883274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 621/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:10.889586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:10.995275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06673872-3bab-463d-a121-6b3cf7931de3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:11.033634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:11.034240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:11.034516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:11.034783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:11.035510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:11.035819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:11.037276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:11.057086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 619/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:11.063308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:11.181337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016eb1-e8ec-4413-8a0a-7a922a9ee56f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:11.220423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:11.221177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:11.221474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:11.221752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:11.302003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:11.309782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:11.311228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:11.426233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 622/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:50:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:50:11.427663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:11.459177 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:11.561397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8595d0-1456-4f88-b586-1aec970964d6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:11.602262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:11.603031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:11.603319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:11.604231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:11.616380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:11.617966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:11.635766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:11.638987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:11.640114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:11.640114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:11.640114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:11.640114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 620/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:11.642779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:11.763477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:11.770799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e24bee-7628-40df-9cb5-51a7695a5e64 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:11.810866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:11.811667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:11.811890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:11.812168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:11.812932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:11.813331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:11.814739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:11.828899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 623/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:11.834874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:11.933710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:11.960227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b9bd2-25ee-4d57-bbf1-3470caa75f8f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:11.996709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:11.997326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:11.997636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:11.997910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:12.004419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:12.005874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:12.017788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:12.018911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:12.019998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:12.023912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 621/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:12.025252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:12.148126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83af4d9-c036-49a9-a304-c40e23d7c9b4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:12.192633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:12.193305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:12.193619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:12.193888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:12.194578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:12.194882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:12.196287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382343-b046-4f51-99cd-22040ceaf7f6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:12.209067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 624/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:12.215401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:12.323410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e686f5-2038-44bf-b5aa-9f7f4215a691 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:12.364027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:12.364582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:12.364859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:12.365128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:12.365880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] RBAC: Adding query filter params (role.id=1fe2b898b9794ecaa6228485f327e7be, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=458dde7e70e746ef9a69f0e8afca9602) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:12.366183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:12.367593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a29fa-bb40-4f41-b048-fc529d7bf7e8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:12.373766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 622/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:50:12 2022] GET /identity/v3/role_assignments?user.id=458dde7e70e746ef9a69f0e8afca9602&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=1fe2b898b9794ecaa6228485f327e7be => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:14.501066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af074-aa22-4a97-b7ac-f49c2c528f80 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:14.501592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af074-aa22-4a97-b7ac-f49c2c528f80 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:14.501592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af074-aa22-4a97-b7ac-f49c2c528f80 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:14.503127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 625/1247] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:14.510948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:14.511441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:14.511533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:14.518089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:14.533376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:14.534608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:14.614954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 623/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:14.897397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518af074-aa22-4a97-b7ac-f49c2c528f80 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:14.918194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:15.015945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518af074-aa22-4a97-b7ac-f49c2c528f80 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.056056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.057264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.057567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.057841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.069741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:15.075853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:15.076994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:15.078059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 626/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:15.083219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:15.195437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f24e8-977c-4310-8d24-08e1b8515da6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.229286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:15.235945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.236613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.236943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.237245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.238067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:15.238391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:15.239914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:15.254017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 624/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:15.255384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:15.343832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:15.368465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3914d2-55c9-47c0-8928-7f6b02a3c601 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.409076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.409737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.409993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.410263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.423274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:15.425026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:15.442492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:15.443667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:15.444585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:15.444585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:15.444585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:15.444585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 627/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:15.451156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:15.576791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96732d9-765f-4b48-b7c0-2d69499fa6bc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.617314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.618087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.618397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.618668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.619582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:15.619891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:15.621789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:15.636855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 625/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:15.643008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:15.759014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd49fd-6838-4862-89c5-ac32a67238de None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.788796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:15.799604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.800444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.800871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.801183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.809119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:15.810626 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:15.822013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:15.823804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:15.824981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 628/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:15.828841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:15.894404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:15.946990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19881f-9bd1-4770-84cc-6f571b80443d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:15.984109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:15.984716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:15.984993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:15.985262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:15.986022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:15.986324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:15.987776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:16.005283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 626/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:16.011981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:16.132889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1d61e-fc5e-4c88-876c-ad89b262da72 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:16.172943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:16.173589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:16.173845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:16.174124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:16.230941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:16.245789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:16.247396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:16.371954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 629/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:50:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:50:16.378046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:16.483422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ae32-0c70-4179-8a14-18bd9ef38b33 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:16.498659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:16.520865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:16.521502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:16.521927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:16.522066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:16.533298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:16.534776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:16.550521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:16.551701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:16.552723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:16.552723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:16.552723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:16.552723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 627/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:16.557906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:16.655621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:16.668422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5f815-b5c9-405a-b563-f8584d033f4f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:16.711748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:16.712347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:16.712690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:16.713009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:16.713682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:16.713980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:16.715314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:16.726098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 630/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:16.731921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:16.845913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333297-e570-4afd-802a-bbb2d817e47c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:16.883219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:16.883847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:16.884152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:16.884404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:16.892006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:16.893445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:16.905261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:16.906398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:16.907320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 628/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:16.912424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:17.015302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0729f7-180c-47e3-8d74-4d2a2f37e910 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:17.049262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:17.049888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:17.050162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:17.050427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:17.051114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:17.051413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:17.052821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277e0c-b559-4834-9ed6-71d3bca96b37 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:17.066216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 631/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:17.072780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:17.105243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:17.190129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592cec5-5568-4460-a58f-7f64fbfb7d67 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:17.225272 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:17.225910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:17.226172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:17.226475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:17.227233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=458dde7e70e746ef9a69f0e8afca9602) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:17.227598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:17.229553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8cdd7-def6-4614-ad18-8a0cf6a8afdb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:17.235079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 629/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:50:17 2022] GET /identity/v3/role_assignments?user.id=458dde7e70e746ef9a69f0e8afca9602&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:19.160258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6016-15fc-49f2-8b03-a7b031b2fdf3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:19.160818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6016-15fc-49f2-8b03-a7b031b2fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:19.160818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6016-15fc-49f2-8b03-a7b031b2fdf3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:19.162166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 632/1261] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:19.167954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:19.168398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:19.168508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:19.187826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:19.188999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:19.252942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 630/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:19.517292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad6016-15fc-49f2-8b03-a7b031b2fdf3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:19.528765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:19.625826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad6016-15fc-49f2-8b03-a7b031b2fdf3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:19.658569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:19.659180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:19.659457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:19.659730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:19.670375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:19.675212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:19.676299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:19.677348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 633/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:19.682597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:19.700568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:19.779627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3346b04-8e3b-4f8e-aa2d-44d18151d014 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:19.812720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:19.813318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:19.813627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:19.813906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:19.814573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:19.814876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:19.816232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:19.824317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 631/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:19.830350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:19.896685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:19.929633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb23a-c6cd-495b-b3df-32835c54ac08 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:19.962365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:19.963718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:19.963993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:19.964263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:19.973822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:19.975234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:19.989138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:19.990279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:19.991160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:19.991160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:19.991160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:19.991160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 634/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:19.996124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.076108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:20.095766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1100-8253-4514-9aa9-afad007e816e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.128225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.128819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.129097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.129369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.130034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:20.130333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.131673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.143781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 632/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:20.149347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.246868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f825ac-c1d3-4bba-af82-7f69c9494914 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.266043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:20.280290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.280904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.281179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.281449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.288562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.290008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:20.301616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:20.302729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:20.303811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 635/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:20.308437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.405325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cf16-e500-47d0-8891-9dbdea808275 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.438541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.439126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.439400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.439666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.440379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:20.440677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.442129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.451207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:20.459705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 633/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:20.465319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.573174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bece5-d0ab-450f-ae51-bf5471249dea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.605693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.606312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.606590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.606860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.616909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.618358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:20.632899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:20.634061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:20.635632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:20.635632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:20.635632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:20.635632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 636/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:20.640895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.737219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db5d85-f62d-4d2b-a83e-fddcc477e7a2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.770030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.770628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.770905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.771176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.771813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:20.772111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.773456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.784308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 634/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:20.789910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:20.820935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:20.887635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d1a18-48f7-403a-8936-e3b10991fa4e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:20.920294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:20.920903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:20.921181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:20.921452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:20.927979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:20.929396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:20.941058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:20.942134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:20.943052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 637/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:20.948518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:21.006676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:21.049900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076281-f91c-4904-a4de-da02bbae4786 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:21.082758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:21.083354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:21.083632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:21.083903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:21.084588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:21.084891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:21.086342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d54f4-783f-4cb8-b639-c33d4f1fd655 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:21.098333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 635/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:21.104524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:21.191551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:21.201229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904445e-83d8-46eb-90df-c01de7c20a78 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:21.232996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:21.233659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:21.233939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:21.234211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] PATH_INFO: `/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/458dde7e70e746ef9a69f0e8afca9602/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:21.236065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=5293034f3e9e474e9139f94a9e9f9b6e, user_id=458dde7e70e746ef9a69f0e8afca9602, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:21.237478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28501-547c-40d5-a334-03389f6a3e93 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:21.250492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 638/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 12:50:21 2022] PUT /identity/v3/projects/5293034f3e9e474e9139f94a9e9f9b6e/users/458dde7e70e746ef9a69f0e8afca9602/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:50:23.157272 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24ec3-f455-4c7e-9167-95b6f541823e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:23.157821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24ec3-f455-4c7e-9167-95b6f541823e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:23.157821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24ec3-f455-4c7e-9167-95b6f541823e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:23.159153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 636/1274] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:23.164241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:23.164668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:23.164795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:23.183917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:23.185096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:23.249365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 639/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:23.518913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24ec3-f455-4c7e-9167-95b6f541823e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:23.617186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24ec3-f455-4c7e-9167-95b6f541823e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:23.634970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:23.651536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:23.652147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:23.652424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:23.652694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:23.662351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:50:23.668385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:23.669686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:23.670889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 637/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 12:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:23.675418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:23.754370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:23.772825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bc93-2915-4182-baaf-ac759a48b23e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:23.805750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:23.806985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:23.807261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:23.807531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:23.808190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:23.808492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:23.809857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:23.817575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 640/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 12:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:23.823334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:23.919731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599e89-62e8-43b0-89b2-3ebcf144f022 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:23.953273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:23.953919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:23.954195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:23.954463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:23.965298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:23.966759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:23.980642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:23.981774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:23.982722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:23.982722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:23.982722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:23.982722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 638/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:50:23.987625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:24.085091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036922d-5874-434f-9891-b8a5bcb16de8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:24.117963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:24.119124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:24.119632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:24.119963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:24.120635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:24.120936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:24.122324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:24.133537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 641/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:24.140070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:24.169793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:24.240034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8ee09-030d-47ba-a8c6-80aaa2c89c39 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:24.272440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:24.273049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:24.273324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:24.273626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:24.280797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:24.282236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:50:24.293217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:24.294374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:24.295341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 639/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:24.300101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:24.303812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:24.407103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4606c-10f8-44c8-8d38-4ac58c83aa10 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:24.440957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:24.441584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:24.441867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:24.442143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:24.442867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:24.443174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:24.444590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:24.461114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 642/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 12:50:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:24.467313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:24.560517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:24.569858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a86f-97aa-4031-85ef-860d01a489c4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:24.601136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:24.601749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:24.602023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:24.602289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:24.666851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:24.668216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:24.752096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:24.762363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 640/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 12:50:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:50:24.768335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:24.827447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:24.864909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde0bb-0597-4004-bcf1-535f3b527863 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:24.896674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:24.897278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:24.897579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:24.897847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:24.907890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:24.909300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:50:24.924188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:24.925307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:50:24.926434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:50:24.926434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:50:24.926434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:24.926434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 643/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:24.930867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:25.028193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd9a2f-69dd-42f5-b1e5-b2d5a32a8895 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:25.061123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:25.061743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:25.062024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:25.062298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:25.062934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:25.063234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:25.064582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:25.076325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 641/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 12:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:25.081916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:25.182721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f830d3-3f78-4e0a-a547-852b35cd5e18 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:25.195579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:25.215567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:25.216181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:25.216460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:25.216733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:25.223202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:25.224620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:50:25.236389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:25.237471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Aug 31 12:50:25.238449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 644/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 12:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:25.243397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:25.292388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:25.342157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2261-dd93-4096-bec2-a873c2946f4a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:25.375265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:25.375860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:25.376141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:25.376415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:25.377108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:25.377415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:25.379017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948d4de-f63d-4104-9dbf-1ca8ebcab0a0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:25.390872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 642/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 12:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:50:25.396904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:25.493430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e77b7-4d2f-4639-a010-fdd987f77e7a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:25.531563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:25.532187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:25.532493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:25.532824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:25.533822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] RBAC: Adding query filter params (role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8, scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e, user.id=458dde7e70e746ef9a69f0e8afca9602) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:25.534226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:25.535671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c63c-da57-43dd-a8f0-9a09696dfd4a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:25.542469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 645/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 12:50:25 2022] GET /identity/v3/role_assignments?user.id=458dde7e70e746ef9a69f0e8afca9602&scope.project.id=5293034f3e9e474e9139f94a9e9f9b6e&role.id=5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:27.460998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ad84-b933-4e95-9d0a-44db83cf669b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:27.461538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ad84-b933-4e95-9d0a-44db83cf669b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:27.461538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ad84-b933-4e95-9d0a-44db83cf669b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:27.463643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 643/1288] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:27.468898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:27.469324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:27.469542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:27.487486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:27.488663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:27.522115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:27.559394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 646/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:27.830244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ad84-b933-4e95-9d0a-44db83cf669b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:27.935228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ad84-b933-4e95-9d0a-44db83cf669b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:27.945870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:27.969221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:27.969891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:27.970166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:27.970433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:27.971009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:27.972356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:27.981868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:27.983124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:27.983966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 644/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:50:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:27.988871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:28.087193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdf868-415f-43e7-b842-31d6bf92f3a1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:28.122982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:28.123579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:28.123856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:28.124132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:28.124759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:28.125057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:28.126434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e06f9-fb4c-4b35-b6e0-ddb87bd51417 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:28.131035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 647/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 12:50:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:28.137370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:28.233701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2613-98cb-411b-b8d8-98137038fc43 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:28.265738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:28.266330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:28.266604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:28.266871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:28.267493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:28.267786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:28.269126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c879082-7dee-4c68-9456-835885f92a50 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:28.273393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 645/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 12:50:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:30.192375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144b33-bda0-4120-9700-d6d6f3e53aaa None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:30.192856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144b33-bda0-4120-9700-d6d6f3e53aaa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:30.192974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144b33-bda0-4120-9700-d6d6f3e53aaa None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:30.194383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 648/1293] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:30.199924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034f7c-bbc8-468b-87a5-fedf87ca65de None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:30.200320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034f7c-bbc8-468b-87a5-fedf87ca65de None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:30.200470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034f7c-bbc8-468b-87a5-fedf87ca65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:30.219056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-00034f7c-bbc8-468b-87a5-fedf87ca65de None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:30.220213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00034f7c-bbc8-468b-87a5-fedf87ca65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:30.249626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:30.286905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 646/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:30.580969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2144b33-bda0-4120-9700-d6d6f3e53aaa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:30.612084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:30.681807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2144b33-bda0-4120-9700-d6d6f3e53aaa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:30.715771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:30.716362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:30.716639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:30.716912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:30.717593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:30.718947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c728-531c-498d-9695-057fd468cfec None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:30.732568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 649/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 12:50:30 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:50:32.645633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2877-c266-4dea-901e-c331c2571965 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:32.646179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2877-c266-4dea-901e-c331c2571965 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:32.646179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2877-c266-4dea-901e-c331c2571965 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:32.647612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 647/1296] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:32.652994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:32.653388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:32.653572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:32.672170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:32.673344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:32.743165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 650/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:33.010025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f2877-c266-4dea-901e-c331c2571965 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:33.110696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f2877-c266-4dea-901e-c331c2571965 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:33.143851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:33.144469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:33.144755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:33.145029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:33.145641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:33.147061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:33.156313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:33.157470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:33.158632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 648/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:50:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:33.163371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:33.181916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:33.262279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b07f5-c138-4c4e-aac6-e3ec87e07333 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:33.304461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:33.305053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:33.305326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:33.305623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:33.306279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:33.306571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:33.307939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:33.312865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 651/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 12:50:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:33.318984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:33.350354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:33.418375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aaf9b-9154-4692-9600-d93770f6eaeb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:33.451491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:33.452088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:33.452368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:33.452641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:33.453340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] RBAC: Adding query filter params (interface=public, service_id=31e6ed2c732f4e52a7163eb88d6a5045, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:33.453676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:33.455027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb3e-7912-47a7-bea7-450ccee8e72c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:33.460098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 649/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 12:50:33 2022] GET /identity/v3/endpoints?service_id=31e6ed2c732f4e52a7163eb88d6a5045&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:33.466732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:33.557513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:33.577367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc059-34a3-4a21-8dcd-41a08e1ad852 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:33.610230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:33.610825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:33.611100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:33.611367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:33.611958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:33.613300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6c61b-0d4b-48f2-914a-225ed918b179 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:33.619870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 652/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 12:50:33 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:50:35.506350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08b75-5fa2-41bb-b53e-ca8c814b6ad7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:35.506863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08b75-5fa2-41bb-b53e-ca8c814b6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:35.506863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08b75-5fa2-41bb-b53e-ca8c814b6ad7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:35.508151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 650/1302] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:50:35.513383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:35.513818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:35.514007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:35.532279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:50:35.533454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:50:35.597181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 653/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:50:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:50:35.863517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08b75-5fa2-41bb-b53e-ca8c814b6ad7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:35.956730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:35.964107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08b75-5fa2-41bb-b53e-ca8c814b6ad7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:35.996293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:35.996903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:35.997176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:35.997441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:35.998041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:35.999387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:50:36.007804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:50:36.009015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Aug 31 12:50:36.010062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 651/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 12:50:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:50:36.015332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:36.088106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:36.111254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c1b2-d06b-48c6-b968-41b4f7823edd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:36.145062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:36.145623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:36.145901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:36.146171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:36.146796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:50:36.147096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:36.148443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c795ae-0ba5-4534-9c7c-236ac78fa097 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:36.153327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 654/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 12:50:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:50:36.158983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:50:36.255537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6e04-d73e-4976-9347-51856c6322ba None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:50:36.288184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:50:36.288768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:50:36.289044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:50:36.289315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:50:36.290010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:50:36.291932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15e253-eb20-4174-ac60-bae1b5b81605 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:50:36.310252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 652/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:50:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:50:46.150552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=30 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:50:46.305977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:40.096826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0eabf-0177-4c48-9d7c-4a6efc8fe080 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:40.097394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0eabf-0177-4c48-9d7c-4a6efc8fe080 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:40.097394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0eabf-0177-4c48-9d7c-4a6efc8fe080 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:40.103469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 655/1307] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:40.105226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ba7e-0af5-4174-9020-4be16e9eee97 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:40.107706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ba7e-0af5-4174-9020-4be16e9eee97 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:40.108220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ba7e-0af5-4174-9020-4be16e9eee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:40.187485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4a21ba7e-0af5-4174-9020-4be16e9eee97 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:40.189022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4a21ba7e-0af5-4174-9020-4be16e9eee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:40.304225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 653/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:40.606367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:40.606649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:40.606934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:40.608508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 656/1309] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 31 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:40.614998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4c50-8a59-4278-839d-89e80781c9c7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:40.615286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4c50-8a59-4278-839d-89e80781c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:40.615560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4c50-8a59-4278-839d-89e80781c9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:40.728121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b40d4c50-8a59-4278-839d-89e80781c9c7 None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:40.729329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b40d4c50-8a59-4278-839d-89e80781c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:40.752411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:40.813733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 654/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 31 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:40.823518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:40.825880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:40.945932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8fe59-2d10-49d8-8c53-05394cf79c5f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:41.025951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:41.026568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:41.026847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:41.027115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:41.028707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:41.097260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:41.160836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:41.162402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1da3f-0f73-4abe-a06a-c1d5b40164d1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:41.186224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 657/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:43.444674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:43.445227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:43.445336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:43.446857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 655/1312] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:43.452649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939450-f72c-479b-8d5a-08a2f436b85c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:43.453177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939450-f72c-479b-8d5a-08a2f436b85c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:43.453265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939450-f72c-479b-8d5a-08a2f436b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:43.545150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fc939450-f72c-479b-8d5a-08a2f436b85c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:43.546458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc939450-f72c-479b-8d5a-08a2f436b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:43.645182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 658/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:43.927916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:43.929581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:44.031613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dff422-58ac-4d31-baed-7ddf0b6ccd9c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:44.102931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:44.105316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:44.105961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:44.106521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:44.106973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:44.108768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:44.215503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:44.216921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba6b56-129c-4c5b-9cd3-d5070c408138 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:44.234846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 656/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:46.484940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:46.485473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:46.485473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:46.486894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 659/1315] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:46.492643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6215-c26f-422e-8221-ac44bdb27f75 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:46.493031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6215-c26f-422e-8221-ac44bdb27f75 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:46.493201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6215-c26f-422e-8221-ac44bdb27f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:46.560769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e8be6215-c26f-422e-8221-ac44bdb27f75 None None] MFA Rules not processed for user `74e95fb0b04948b3bae443ca4a948045`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:46.562001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e8be6215-c26f-422e-8221-ac44bdb27f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:46.613921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:46.660819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 657/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:46.950969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:46.952500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:46.962917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:47.055628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067a66-ea9a-43f9-aa68-924ec9799763 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:47.133433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:47.134071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:47.134350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:47.134620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:47.136255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:47.199566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:47.245789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:47.247213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2859f-1a41-4362-8be3-999d30ede8b1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:47.265013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 660/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:49.753244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:49.753814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:49.753911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:49.755203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 658/1318] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:49.760480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa73e-8cfa-4350-8a25-664c5445aa81 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:49.760919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa73e-8cfa-4350-8a25-664c5445aa81 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:49.761042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa73e-8cfa-4350-8a25-664c5445aa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:49.829274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-25baa73e-8cfa-4350-8a25-664c5445aa81 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:49.830536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-25baa73e-8cfa-4350-8a25-664c5445aa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:49.925349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 661/1319] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:50.214655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:50.216175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:50.317935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c3562-4aeb-4b2a-95d3-6a9b660ead4b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:50.388489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:50.389012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:50.389285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:50.389582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:50.391142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:50.399769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:50.501435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:50.502903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3c7bb-7230-4085-bcac-cd89200c3b8d service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:50.521493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 659/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:53.115725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:53.116172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:53.116281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:53.118059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 662/1321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:53.123239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cbae8-89bc-43c0-afff-a22f7a9c4b2f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:53.123704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cbae8-89bc-43c0-afff-a22f7a9c4b2f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:53.123813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cbae8-89bc-43c0-afff-a22f7a9c4b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:53.199824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-992cbae8-89bc-43c0-afff-a22f7a9c4b2f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:53.203362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-992cbae8-89bc-43c0-afff-a22f7a9c4b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:53.265621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.304941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 660/1322] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:53.591308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:53.592898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:53.612817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.696960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a4ce-a61d-4152-b9c3-a655449f3d21 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:53.769162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:53.769737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:53.770016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:53.770285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:53.771856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:53.847035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.885836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:53.887265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d3b1-149b-44ab-8d90-3b9a62967f2a service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:53.908064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 663/1323] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:55.885922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:55.886455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:55.886455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:55.887827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 661/1324] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:51:55.893206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b530-f42a-48a5-bd2c-13bea74238ff None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:55.893636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b530-f42a-48a5-bd2c-13bea74238ff None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:55.893786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b530-f42a-48a5-bd2c-13bea74238ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:55.961113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0345b530-f42a-48a5-bd2c-13bea74238ff None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:55.962361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0345b530-f42a-48a5-bd2c-13bea74238ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:56.061254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 664/1325] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:51:56.342123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:56.343664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:56.459318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973be6-1061-43ae-a855-739d29f9681e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:56.535344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:56.535951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:56.536229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:56.536500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:56.538698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:56.557163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:56.655215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:56.656642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb68f-c1f4-4611-8b6d-e9bdaa51bd5f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:56.675930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 662/1326] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:51:58.667139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:58.667734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:58.667734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:58.669077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 665/1327] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:51:58.674564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64426c3-bafd-4b5e-be07-52a4b6b1c60e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:58.674991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64426c3-bafd-4b5e-be07-52a4b6b1c60e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:58.675129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64426c3-bafd-4b5e-be07-52a4b6b1c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:58.740665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b64426c3-bafd-4b5e-be07-52a4b6b1c60e None None] MFA Rules not processed for user `74e95fb0b04948b3bae443ca4a948045`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:51:58.742740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b64426c3-bafd-4b5e-be07-52a4b6b1c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:58.809357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:58.841785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 663/1328] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:51:59.126312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:51:59.127953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:59.159880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:59.236247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b094-7e19-4fa3-a4dc-851e04390146 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:51:59.311339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:51:59.311864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:51:59.312143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:51:59.312419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:51:59.314025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:51:59.393161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:59.425918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:51:59.427379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e826-e013-4e7d-a98b-7d8aeef583e5 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:51:59.446192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 666/1329] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:01.717980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:01.718554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:01.718554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:01.719898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 664/1330] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:01.725282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d2848-8c5e-4448-b3bc-4ac61d1f0524 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:01.725836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d2848-8c5e-4448-b3bc-4ac61d1f0524 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:01.726132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d2848-8c5e-4448-b3bc-4ac61d1f0524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:01.801801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a08d2848-8c5e-4448-b3bc-4ac61d1f0524 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:01.803033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a08d2848-8c5e-4448-b3bc-4ac61d1f0524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:01.928119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 667/1331] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:52:02.235291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:02.236824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:02.340217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52196312-8ec8-4927-9d2c-1fbe698c8c3a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:02.413824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:02.414690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:02.414964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:02.415226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:02.416814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:02.442687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:02.525241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:02.526707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337d27-b7c4-4269-a90d-4c848d6ede8b service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:02.545385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 665/1332] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:04.496265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:04.496772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:04.496772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:04.498087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 668/1333] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:04.503115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c696-b667-4c52-ac1f-0b941e0246a8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:04.503576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c696-b667-4c52-ac1f-0b941e0246a8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:04.503766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c696-b667-4c52-ac1f-0b941e0246a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:04.569693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a797c696-b667-4c52-ac1f-0b941e0246a8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:04.570883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a797c696-b667-4c52-ac1f-0b941e0246a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:04.642953 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:04.666705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 666/1334] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:04.948366 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:04.949971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:04.989916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:05.053520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3052f-05d8-4194-b8b3-00b23ffcf1c2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:05.126106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:05.126709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:05.127055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:05.127330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:05.128970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:05.213193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:05.239444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:05.240924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104e19-e9e3-4a2f-a90c-70f0022b8494 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:05.260465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 669/1335] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:07.471090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:07.471669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:07.471669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:07.473001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 667/1336] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:07.478212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55337c-eff7-4d64-869a-78eb5a450faf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:07.478620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55337c-eff7-4d64-869a-78eb5a450faf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:07.478765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55337c-eff7-4d64-869a-78eb5a450faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:07.544356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4b55337c-eff7-4d64-869a-78eb5a450faf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:07.545568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4b55337c-eff7-4d64-869a-78eb5a450faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:07.640568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 670/1337] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:07.922742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:07.924280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:08.029310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0108493-8f67-4810-a136-29803818f4a8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:08.101565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:08.102176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:08.102586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:08.102857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:08.104456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:08.139790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:08.213182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:08.214676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4213-8f2d-46f0-baa9-490901e4731c service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:08.232507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 668/1338] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:12.072653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdb43-80af-4ebc-833e-ee59792c4deb None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:12.073191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdb43-80af-4ebc-833e-ee59792c4deb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:12.073191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdb43-80af-4ebc-833e-ee59792c4deb None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:12.074563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 671/1339] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:12.079901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b7c-acbe-410c-a972-e82745431cf8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:12.080305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b7c-acbe-410c-a972-e82745431cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:12.080561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b7c-acbe-410c-a972-e82745431cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:12.149174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-36fd6b7c-acbe-410c-a972-e82745431cf8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:12.150440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-36fd6b7c-acbe-410c-a972-e82745431cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:12.243988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:12.255767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 669/1340] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:12.561645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:12.562039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:12.562378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:12.563791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 672/1341] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 31 12:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:12.570102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884e7f-14c7-491c-8a75-2795ac9d4d6c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:12.570467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884e7f-14c7-491c-8a75-2795ac9d4d6c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:12.570731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884e7f-14c7-491c-8a75-2795ac9d4d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:12.645669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a2884e7f-14c7-491c-8a75-2795ac9d4d6c None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:12.647465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a2884e7f-14c7-491c-8a75-2795ac9d4d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:12.722789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 670/1342] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 31 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:52:12.732369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:12.733916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:12.782941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:12.838187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0d364-bebb-42a0-b799-990a0faa8578 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:12.910416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:12.911030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:12.911309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:12.911585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:12.913310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:13.005709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:13.023010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:13.024445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831565f9-7bf5-4adf-a464-d69f96d7b279 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:13.042620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 673/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:16.154809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:16.155342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:16.155342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:16.156675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 671/1344] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:16.161861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b78f2-fda3-4fa2-9afd-3cada270bfad None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:16.162875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b78f2-fda3-4fa2-9afd-3cada270bfad None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:16.163045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b78f2-fda3-4fa2-9afd-3cada270bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:16.234882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5a4b78f2-fda3-4fa2-9afd-3cada270bfad None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:16.236085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5a4b78f2-fda3-4fa2-9afd-3cada270bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:16.331409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 674/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:16.620169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:16.621796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:16.711003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:16.730032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5d1c-b90f-4bfa-bb6c-7f1d1169b58c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:16.805695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:16.806288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:16.806561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:16.806828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:16.808401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:16.924799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:16.926831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc07e3-932a-489b-b35f-4b23c826d858 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:16.947370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 672/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:20.935852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:20.936375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:20.936375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:20.937840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 675/1347] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:20.943494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc0e5-cb10-4a30-8c2e-860789e453ff None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:20.943994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc0e5-cb10-4a30-8c2e-860789e453ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:20.944088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc0e5-cb10-4a30-8c2e-860789e453ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:20.960199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:21.018495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-655dc0e5-cb10-4a30-8c2e-860789e453ff None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:21.019633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-655dc0e5-cb10-4a30-8c2e-860789e453ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:21.124582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 673/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:21.412413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:21.414272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:21.471261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:21.525615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843747-7dfe-487c-9bf3-fd09f50f014e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:21.597879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:21.598472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:21.598747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:21.599012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:21.601220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:21.704092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:21.708151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:21.710253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002f38-625d-4d0f-a1b5-efa77a747d29 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:21.728185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 676/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:26.652132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1c26-92c4-47d6-b903-3e08530a7f0f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:26.652634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1c26-92c4-47d6-b903-3e08530a7f0f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:26.652737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1c26-92c4-47d6-b903-3e08530a7f0f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:26.655911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 674/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 12:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:26.661050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14637-87c3-44c4-a459-0686c673d991 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:26.662830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14637-87c3-44c4-a459-0686c673d991 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:26.663838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14637-87c3-44c4-a459-0686c673d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:26.768320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b2a14637-87c3-44c4-a459-0686c673d991 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:26.768320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2a14637-87c3-44c4-a459-0686c673d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:26.951982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 677/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:31.123001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=59 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:31.181920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abdeb0-b44a-406d-8eca-a6a2dd1177db None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:31.182456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abdeb0-b44a-406d-8eca-a6a2dd1177db None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:31.182892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abdeb0-b44a-406d-8eca-a6a2dd1177db None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:31.184400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 675/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 12:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:31.189529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff00d4-c752-4956-9c86-b584d387544d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:31.190027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff00d4-c752-4956-9c86-b584d387544d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:31.190306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff00d4-c752-4956-9c86-b584d387544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:31.248689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:31.272699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3cff00d4-c752-4956-9c86-b584d387544d None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:31.274087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3cff00d4-c752-4956-9c86-b584d387544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:31.386106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 678/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:32.828446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c5a-0966-4fd3-bd4e-d3e5261e3e9f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:32.828980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c5a-0966-4fd3-bd4e-d3e5261e3e9f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:32.829103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c5a-0966-4fd3-bd4e-d3e5261e3e9f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:32.830567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 676/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 12:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:32.836369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee735-4034-4d38-8713-0ff9550e55c7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:32.836872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee735-4034-4d38-8713-0ff9550e55c7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:32.836970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafee735-4034-4d38-8713-0ff9550e55c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:32.915455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bafee735-4034-4d38-8713-0ff9550e55c7 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:32.916664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bafee735-4034-4d38-8713-0ff9550e55c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:32.959482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:33.025861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 679/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:36.311493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50806132-9ff5-4ea8-ad2b-021b90d8f4dd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:36.312321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50806132-9ff5-4ea8-ad2b-021b90d8f4dd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:36.312321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50806132-9ff5-4ea8-ad2b-021b90d8f4dd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:36.313387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 677/1356] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:36.319977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b33-9752-4e06-8eef-f9cfa4a02f34 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:36.320463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b33-9752-4e06-8eef-f9cfa4a02f34 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:36.320557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b33-9752-4e06-8eef-f9cfa4a02f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:36.410150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-476d9b33-9752-4e06-8eef-f9cfa4a02f34 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:36.411390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-476d9b33-9752-4e06-8eef-f9cfa4a02f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:36.540001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 680/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:52:36.845504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:36.846393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:36.846902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:36.849331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 678/1358] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 12:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:52:36.861248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3164-6d05-4b50-80f5-59f08b32cfb0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:36.861877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3164-6d05-4b50-80f5-59f08b32cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:36.862356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3164-6d05-4b50-80f5-59f08b32cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:36.882459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:36.947599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bf1b3164-6d05-4b50-80f5-59f08b32cfb0 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:36.949308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf1b3164-6d05-4b50-80f5-59f08b32cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:37.087930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 681/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:37.099968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:37.101512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:37.257618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782b92-5458-454d-a2cd-c54e9fe74e31 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:37.336724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:37.380867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:37.381505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:37.381802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:37.382078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:37.383670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:37.476019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:37.477643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fe5d6-29c8-4ca8-8530-d9ccb9668305 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:37.496765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 679/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:39.765153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:39.765714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:39.765714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:39.766984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 682/1361] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:39.774331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134134-fc84-4019-8447-46ef5bfa21b1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:39.774984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134134-fc84-4019-8447-46ef5bfa21b1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:39.774984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134134-fc84-4019-8447-46ef5bfa21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:39.861988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-be134134-fc84-4019-8447-46ef5bfa21b1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:39.863261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-be134134-fc84-4019-8447-46ef5bfa21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:39.907685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:39.982482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 680/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:40.275834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:40.277387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:40.346775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:40.434098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae784394-a409-4b5b-ac81-9bea02bea9ea None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:40.562843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:40.563451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:40.563726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:40.563995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:40.565693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:40.593706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:40.679227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:40.681111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132916-5f7d-4870-9d2c-17aea686594e service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:40.703387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 683/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:42.986307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170f639-bbaf-45dc-909e-49ea53b09650 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:42.986844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170f639-bbaf-45dc-909e-49ea53b09650 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:42.986844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170f639-bbaf-45dc-909e-49ea53b09650 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:42.988259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 681/1364] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:42.993832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128bdd-7f10-499a-b772-e0d5436b9e0e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:42.994226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128bdd-7f10-499a-b772-e0d5436b9e0e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:42.994387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128bdd-7f10-499a-b772-e0d5436b9e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:43.063440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bb128bdd-7f10-499a-b772-e0d5436b9e0e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:43.064671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bb128bdd-7f10-499a-b772-e0d5436b9e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:43.170783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:43.173328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 684/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:52:43.469382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:43.469752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:43.469987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:43.471625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 682/1366] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 12:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:43.477905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1e39-6e10-44c5-afed-e1f61a997aea None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:43.478267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1e39-6e10-44c5-afed-e1f61a997aea None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:43.478643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e1e39-6e10-44c5-afed-e1f61a997aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:43.560636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-564e1e39-6e10-44c5-afed-e1f61a997aea None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:43.561867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-564e1e39-6e10-44c5-afed-e1f61a997aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:43.685707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 685/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:43.694821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:43.696102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:43.855061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7024cb-3807-4e0d-af53-1de308dcee3d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:43.876549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:43.984533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:43.985150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:43.985431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:43.985735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:43.987328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:44.082468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:44.084149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d658359-5665-41cf-bb1b-df2d1c8df0f0 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:44.113665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 683/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:52:44.584748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a07a-b20d-431d-9ee1-36c0bce3961e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:44.585275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a07a-b20d-431d-9ee1-36c0bce3961e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:44.585275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a07a-b20d-431d-9ee1-36c0bce3961e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:44.586901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 686/1369] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:44.591910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1979-ce7b-459c-afd5-b4bbc01d2e19 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:44.592199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1979-ce7b-459c-afd5-b4bbc01d2e19 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:44.592476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1979-ce7b-459c-afd5-b4bbc01d2e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:44.626942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:44.666358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5b3e1979-ce7b-459c-afd5-b4bbc01d2e19 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:44.667590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5b3e1979-ce7b-459c-afd5-b4bbc01d2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:44.776900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 684/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:45.378369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:45.378369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:45.378369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:45.381742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 687/1371] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 31 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:45.384748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4614b9-423a-4e4c-bc60-03e949893754 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:45.385245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4614b9-423a-4e4c-bc60-03e949893754 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:45.385405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4614b9-423a-4e4c-bc60-03e949893754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:45.465246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fd4614b9-423a-4e4c-bc60-03e949893754 None None] MFA Rules not processed for user `ce3ffcb22c2e4dfe8d9341d82c8bb716`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:45.466490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd4614b9-423a-4e4c-bc60-03e949893754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:45.517784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:45.551893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 685/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 31 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:45.559474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:45.561104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:45.615479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:45.673595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a83fbe-2dff-47ee-8eaa-af3256eecae3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:45.761034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:45.766019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:45.766429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:45.771547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:45.773642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:45.886129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:45.900949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:45.902488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082029a9-77dd-456b-836c-49cda5634641 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:45.923444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 688/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:52:46.129659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c728-0669-4428-854e-86c811431ce0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:46.129887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c728-0669-4428-854e-86c811431ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:46.130243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c728-0669-4428-854e-86c811431ce0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:46.131601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 686/1374] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:46.136863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebeeb8-f545-4a9b-a7f2-8bee9cc392c8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:46.137149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebeeb8-f545-4a9b-a7f2-8bee9cc392c8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:46.137440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebeeb8-f545-4a9b-a7f2-8bee9cc392c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:46.205065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5bebeeb8-f545-4a9b-a7f2-8bee9cc392c8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:46.206400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5bebeeb8-f545-4a9b-a7f2-8bee9cc392c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:46.306074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 689/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:52:46.601772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c728-0669-4428-854e-86c811431ce0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:46.603316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-df54c728-0669-4428-854e-86c811431ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:46.752993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c728-0669-4428-854e-86c811431ce0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:46.810692 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:46.873197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:46.873858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:46.874138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:46.874413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:46.876013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:46.968206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:46.969888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf736b-8842-47f1-84a5-e505e80196de service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:46.988082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 687/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:48.969113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:48.969815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:48.969815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:48.971118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 690/1377] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:48.976414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e85a-4394-4b4a-97b7-6732cb8b3849 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:48.976827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e85a-4394-4b4a-97b7-6732cb8b3849 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:48.976942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e85a-4394-4b4a-97b7-6732cb8b3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:49.058917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6962e85a-4394-4b4a-97b7-6732cb8b3849 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:49.060015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6962e85a-4394-4b4a-97b7-6732cb8b3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:49.066559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:49.163480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 688/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:49.476016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:49.478142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:49.567721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:49.660388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1be49-96ff-4861-925c-efe85a45b1ca None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:49.783812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:49.784416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:49.784692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:49.784963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:49.786684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:49.806564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:49.894698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:49.897166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c149a-f51c-4635-81d3-7fd50487e23a service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:49.917327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 691/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:51.874949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:51.875583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:51.875583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:51.877074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 689/1380] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:51.883393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a938-f302-4b36-a6f1-f07b1d7de290 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:51.883922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a938-f302-4b36-a6f1-f07b1d7de290 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:51.883922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a938-f302-4b36-a6f1-f07b1d7de290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:51.951634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6078a938-f302-4b36-a6f1-f07b1d7de290 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:51.952845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6078a938-f302-4b36-a6f1-f07b1d7de290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:52.045990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:52.053860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 692/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:52.354045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:52.355582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:52.510431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:52.523072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00199-fe5f-4bb2-bc45-3e8cdb326903 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:52.650487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:52.650997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:52.651277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:52.651552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:52.653464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:52.752495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:52.754417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fa386-c086-44e1-8a3c-b171948c36f2 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:52.766010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:52.776491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 690/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:54.756849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:54.757524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:54.757524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:54.758764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 693/1383] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:54.765804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baed38-3d96-42f2-b851-299bd78f56f3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:54.766265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baed38-3d96-42f2-b851-299bd78f56f3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:54.766572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baed38-3d96-42f2-b851-299bd78f56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:54.838657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e6baed38-3d96-42f2-b851-299bd78f56f3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:54.839846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e6baed38-3d96-42f2-b851-299bd78f56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:54.941241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 691/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:55.224951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:55.226518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:55.390689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf87e8-6910-45e8-a667-b230c4c4d9dc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:55.472335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:55.530932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:55.531696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:55.532048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:55.532399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:55.534548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:55.643410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:55.645400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587f3d8-c4f1-4a9e-a7d4-30b71179ad5e service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:55.664260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 694/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:57.571492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:57.572056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:57.572056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:57.573370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 692/1386] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:52:57.578527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d282-152d-4a5a-9134-9de5adbf5d63 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:57.579030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d282-152d-4a5a-9134-9de5adbf5d63 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:57.579030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d282-152d-4a5a-9134-9de5adbf5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:57.644259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-df65d282-152d-4a5a-9134-9de5adbf5d63 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:52:57.646414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-df65d282-152d-4a5a-9134-9de5adbf5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:57.680231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:57.746466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 695/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:52:58.118422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:52:58.119979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:58.206387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:58.280704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf37354-dd82-4226-bc09-b79d82dab05b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:52:58.408041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:52:58.408674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:52:58.408947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:52:58.409214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:52:58.410964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:52:58.450389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:58.507933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:52:58.509849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd038226-4eea-43f4-bd68-309cce55d11f service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:52:58.529210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 693/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:00.501206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:00.501812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:00.501812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:00.503129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 696/1389] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:00.509084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3324-3aa4-4da5-bf9c-e6c44e0e7b42 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:00.509780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3324-3aa4-4da5-bf9c-e6c44e0e7b42 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:00.509780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3324-3aa4-4da5-bf9c-e6c44e0e7b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:00.578902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-130a3324-3aa4-4da5-bf9c-e6c44e0e7b42 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:00.580119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-130a3324-3aa4-4da5-bf9c-e6c44e0e7b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:00.686963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 694/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:00.974580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:00.976085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:01.129131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcf93-1502-4c34-80bc-f36dae93567b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:01.145468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:01.242537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:01.243050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:01.243323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:01.243587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:01.245160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:01.336568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:01.338210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832140b7-76b7-49af-bd69-7f38e67c8786 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:01.356610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 697/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:02.178163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296927b8-1835-40d2-bba3-dcdd056088d1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:02.178674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296927b8-1835-40d2-bba3-dcdd056088d1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:02.178674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296927b8-1835-40d2-bba3-dcdd056088d1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:02.179985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 695/1392] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:02.185252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87e28-f453-4c83-9008-c146b2fd4106 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:02.187356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87e28-f453-4c83-9008-c146b2fd4106 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:02.187356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87e28-f453-4c83-9008-c146b2fd4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:02.212045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:02.256270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b2e87e28-f453-4c83-9008-c146b2fd4106 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:02.257498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2e87e28-f453-4c83-9008-c146b2fd4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:02.355127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 698/1393] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:02.664915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:02.665267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:02.665645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:02.667069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 696/1394] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 31 12:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:02.672351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492df4-93ba-4f10-a755-6f3b6d4a8880 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:02.672640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492df4-93ba-4f10-a755-6f3b6d4a8880 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:02.672917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492df4-93ba-4f10-a755-6f3b6d4a8880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:02.751313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-21492df4-93ba-4f10-a755-6f3b6d4a8880 None None] MFA Rules not processed for user `03e8d2a225934b7686b885ec53c71ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:02.752432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-21492df4-93ba-4f10-a755-6f3b6d4a8880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:02.794443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:02.833342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 699/1395] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 31 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:02.840763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:02.842290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:02.856498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:02.950209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cc46-16f5-4ef9-88da-93fdf76afe1e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:03.022846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:03.023371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:03.023649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:03.023922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:03.025577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:03.094580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:03.150442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:03.151879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefb74c-f605-4da6-9cc0-40e9ab1f43e8 service glance] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:03.170165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 697/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:03.330221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44923-2c24-4986-a920-51fb02080885 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:03.330777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44923-2c24-4986-a920-51fb02080885 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:03.330777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44923-2c24-4986-a920-51fb02080885 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:03.332731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 700/1397] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:03.338611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be335-ed7e-4232-96e4-fcb24359cbd5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:03.339119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be335-ed7e-4232-96e4-fcb24359cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:03.339226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be335-ed7e-4232-96e4-fcb24359cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:03.429974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2c7be335-ed7e-4232-96e4-fcb24359cbd5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:03.431209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2c7be335-ed7e-4232-96e4-fcb24359cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:03.549187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 698/1398] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:03.889117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f44923-2c24-4986-a920-51fb02080885 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:03.890690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-70f44923-2c24-4986-a920-51fb02080885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:03.976484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f50ed-7369-47a1-befb-947217e8e129 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:03.976752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f50ed-7369-47a1-befb-947217e8e129 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:03.977029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f50ed-7369-47a1-befb-947217e8e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:04.007222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:04.054188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7b7f50ed-7369-47a1-befb-947217e8e129 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:04.055418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b7f50ed-7369-47a1-befb-947217e8e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:04.068793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f44923-2c24-4986-a920-51fb02080885 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:04.117755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:04.148324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 699/1399] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:53:04.187262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:04.187877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:04.188156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:04.188430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:04.190080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:04.195459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc026e-1e9e-40fe-b710-ce52ca3fe7c2 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:04.195745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc026e-1e9e-40fe-b710-ce52ca3fe7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:04.196019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc026e-1e9e-40fe-b710-ce52ca3fe7c2 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:04.197556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 700/1400] 10.222.0.49 () {54 vars in 943 bytes} [Wed Aug 31 12:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:53:04.203510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6daf8-ea28-4bde-93ba-afad1476eff2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:04.203793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6daf8-ea28-4bde-93ba-afad1476eff2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:04.204059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6daf8-ea28-4bde-93ba-afad1476eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:04.281868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-47c6daf8-ea28-4bde-93ba-afad1476eff2 None None] MFA Rules not processed for user `f2f1d6fdb382403cb9b9d4c60cf582bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:04.283223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-47c6daf8-ea28-4bde-93ba-afad1476eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:04.287489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:04.289348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:04.307628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 701/1401] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:04.340977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:04.401278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 701/1402] 10.222.0.49 () {58 vars in 1040 bytes} [Wed Aug 31 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:04.411942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:04.414733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:04.483210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:04.521989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf515ab-510f-46ac-8f8f-aca6b601078f service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:04.628038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:04.629094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:04.629380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:04.629677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:04.631309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:04.715146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:04.716725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3948d-016f-4c7c-95c5-6db736c8722b service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:04.721175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:04.729230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 702/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 12:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:53:06.317706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:06.318260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:06.318260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:06.319512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 702/1404] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:06.324639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34b9c-0943-41ed-88c4-d7e9976885df None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:06.325075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34b9c-0943-41ed-88c4-d7e9976885df None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:06.325228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34b9c-0943-41ed-88c4-d7e9976885df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:06.409227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-05e34b9c-0943-41ed-88c4-d7e9976885df None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:06.410980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-05e34b9c-0943-41ed-88c4-d7e9976885df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:06.559806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 703/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:06.853539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:06.855060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:07.037410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341376-f9f0-4f93-850d-a6f2f64ab6e8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:07.076328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:07.186803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:07.187421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:07.187705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:07.187978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:07.189637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:07.289873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:07.292124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e29b7-c613-4a04-8322-6651e4b6d9b1 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:07.322961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 703/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:09.292155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:09.292155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:09.292155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:09.293180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 704/1407] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:09.298542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468c92-1fb2-46e9-a496-19642ba1f23d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:09.298965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468c92-1fb2-46e9-a496-19642ba1f23d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:09.299136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b468c92-1fb2-46e9-a496-19642ba1f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:09.343620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:09.372940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8b468c92-1fb2-46e9-a496-19642ba1f23d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:09.374232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8b468c92-1fb2-46e9-a496-19642ba1f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:09.485447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 704/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:09.779345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:09.780847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:09.873805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:09.950810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a3ba4-6ffd-46b2-a296-1be46cfc975a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:10.083900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:10.084509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:10.084785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:10.085062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:10.087369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:10.139012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:10.192968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:10.194625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a211-4146-4a44-bd42-f07bf3114beb service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:10.213183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 705/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:19.483335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=51 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:20.210681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=27 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:26.744312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408f8-56ec-4ca2-b995-a001ad3873bc None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:26.744899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408f8-56ec-4ca2-b995-a001ad3873bc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:26.744899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30408f8-56ec-4ca2-b995-a001ad3873bc None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:26.746247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 705/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 31 12:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:26.751425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e512b-f06f-4914-8e6f-3dadee0441a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:26.751835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e512b-f06f-4914-8e6f-3dadee0441a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:26.751963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e512b-f06f-4914-8e6f-3dadee0441a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:26.829281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-586e512b-f06f-4914-8e6f-3dadee0441a6 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:26.830527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-586e512b-f06f-4914-8e6f-3dadee0441a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:26.936809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 706/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 31 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:53:26.951909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabe8f-9df5-4088-90f2-13543d3aaa04 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:26.952273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabe8f-9df5-4088-90f2-13543d3aaa04 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:26.952607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabe8f-9df5-4088-90f2-13543d3aaa04 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:26.954060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 706/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 31 12:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:26.958856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc19f-bb7c-47de-a4d8-64297e6ffd22 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:26.959270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc19f-bb7c-47de-a4d8-64297e6ffd22 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:26.959554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc19f-bb7c-47de-a4d8-64297e6ffd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:27.031044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:27.033892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-953fc19f-bb7c-47de-a4d8-64297e6ffd22 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:27.035963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-953fc19f-bb7c-47de-a4d8-64297e6ffd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:27.150473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 707/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 31 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:53:29.573009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:29.573565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:29.573565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:29.574847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:29.580343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bb6a-8968-4da6-822c-f4d125eaaf33 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:29.580864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bb6a-8968-4da6-822c-f4d125eaaf33 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:29.581673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bb6a-8968-4da6-822c-f4d125eaaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:29.645768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-27b7bb6a-8968-4da6-822c-f4d125eaaf33 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:29.646951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-27b7bb6a-8968-4da6-822c-f4d125eaaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:29.701169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:29.743629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:53:30.034469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:30.036195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:30.183197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533ad5-a9ec-4c78-9139-dd0c5361dc45 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:30.256493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:30.297788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:30.298394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:30.298669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:30.298936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:30.300525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:30.388771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:30.390397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b2680-dbab-4be0-bf79-d1bb286d67ac service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:30.408836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 708/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:31.296586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:31.297150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:31.297150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:31.298557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:31.304007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063e0e-c3f7-4e17-9444-f4e99facea5a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:31.304430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063e0e-c3f7-4e17-9444-f4e99facea5a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:31.304531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063e0e-c3f7-4e17-9444-f4e99facea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:31.378662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e5063e0e-c3f7-4e17-9444-f4e99facea5a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:31.379814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e5063e0e-c3f7-4e17-9444-f4e99facea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:31.406110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:31.477881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:31.629144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:31.630610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:31.778905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a5d8-0ed6-4bfc-b8ec-3973ca46fd00 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:31.821294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:31.896715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:31.897245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:31.897553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:31.897825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:31.899431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:31.985950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:31.987669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cb51f-6cc6-4361-9f00-7e1977afca8f service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:32.005370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 710/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:32.917157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:32.917764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:32.917764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:32.919123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:32.924184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce96b-1872-4d8b-b81b-84840d7414b5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:32.925137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce96b-1872-4d8b-b81b-84840d7414b5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:32.925283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce96b-1872-4d8b-b81b-84840d7414b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:32.978870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:33.001566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3e2ce96b-1872-4d8b-b81b-84840d7414b5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:33.003434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3e2ce96b-1872-4d8b-b81b-84840d7414b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:33.098701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:33.284028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:33.286641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:33.430557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429403c-473e-4e78-8a55-f80d1e64bdcf None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:33.443284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:33.545245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:33.545801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:33.546076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:33.546342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:33.547976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:33.636288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:33.637900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b41c26-8cc3-42bf-bba6-bc97ddf84249 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:33.656008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 711/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:34.524191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:34.524736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:34.524736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:34.526108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:34.531132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8730-cea8-4403-a15f-35734d9ee7a5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:34.531533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8730-cea8-4403-a15f-35734d9ee7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:34.531775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8730-cea8-4403-a15f-35734d9ee7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:34.551690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:34.607897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-571d8730-cea8-4403-a15f-35734d9ee7a5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:34.609103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-571d8730-cea8-4403-a15f-35734d9ee7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:34.704963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:34.855768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:34.857293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:34.966917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:35.003588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd8db4-f5a3-4be7-8344-685e6f973d68 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:35.115555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:35.116105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:35.116385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:35.116658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:35.118301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:35.194409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:35.208735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:35.210361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edef92-2963-431e-9bad-0781d96d6a97 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:35.229098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 713/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:36.091086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:36.091636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:36.091636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:36.093005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:36.098451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8a25-6008-4986-b01f-345d3a722c12 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:36.098907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8a25-6008-4986-b01f-345d3a722c12 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:36.099021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8a25-6008-4986-b01f-345d3a722c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:36.173452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d72e8a25-6008-4986-b01f-345d3a722c12 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:36.175180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d72e8a25-6008-4986-b01f-345d3a722c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:36.270155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:36.428666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:36.430120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:36.516933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:36.578573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1f3b-4c9c-43ff-ad12-7df86287f28a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:36.692177 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:36.692690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:36.692961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:36.693226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:36.694843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:36.743530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:36.785533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:36.787174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e77876-99b1-4aef-b53e-37ddde7669cd service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:36.805811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 714/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:37.614098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:37.614673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:37.614673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:37.615979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:37.620808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f29a-99d1-41f3-ab38-14b469ef3ec1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:37.621342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f29a-99d1-41f3-ab38-14b469ef3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:37.621342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f29a-99d1-41f3-ab38-14b469ef3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:37.697124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9708f29a-99d1-41f3-ab38-14b469ef3ec1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:37.698369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9708f29a-99d1-41f3-ab38-14b469ef3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:37.795115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:37.945526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:37.947019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:37.994554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:38.090859 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0337f42-2962-41ca-beaf-0b4a74cf2825 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:38.206276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:38.206796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:38.207070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:38.207339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:38.208924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:38.215697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:38.296598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:38.298222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de023b-d6aa-45a0-9548-63027790d17d service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:38.316934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 716/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:39.139682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:39.140156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:39.140260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:39.141597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:39.146715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0194eb-3dcb-46cf-9952-2e130c507240 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:39.147150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0194eb-3dcb-46cf-9952-2e130c507240 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:39.147258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0194eb-3dcb-46cf-9952-2e130c507240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:39.228579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cf0194eb-3dcb-46cf-9952-2e130c507240 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:39.229777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf0194eb-3dcb-46cf-9952-2e130c507240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:39.299266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:39.328287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:39.478766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:39.480226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:39.498239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:39.629845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f85fc-e0df-4f08-b7a0-2c3c57c0bd4b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:39.716587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:39.743285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:39.743822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:39.744107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:39.744379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:39.746014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:39.834033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:39.835639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259fe6-fd76-4d2f-ac2a-8bbc90f28097 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:39.853389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 717/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:40.662817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:40.663575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:40.663695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:40.664979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:40.670008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6478e-bdb7-44a2-a75a-eaa7b67339bc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:40.670434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6478e-bdb7-44a2-a75a-eaa7b67339bc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:40.670556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6478e-bdb7-44a2-a75a-eaa7b67339bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:40.748700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-deb6478e-bdb7-44a2-a75a-eaa7b67339bc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:40.749952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-deb6478e-bdb7-44a2-a75a-eaa7b67339bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:40.792146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:40.847404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:40.999021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:41.000475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:41.147647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c85bf-1bea-4312-ad52-5d434a2963fd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:41.201666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:41.260306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:41.260837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:41.261112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:41.261382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:41.262994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:41.351375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:41.353004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd987-f1cf-4f49-8901-acd77ce93ca5 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:41.373462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 719/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:42.183053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:42.183583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:42.183696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:42.185030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:42.189989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232f2b-0303-44b5-a246-3f46df74db7d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:42.190538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232f2b-0303-44b5-a246-3f46df74db7d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:42.190665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232f2b-0303-44b5-a246-3f46df74db7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:42.268028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f5232f2b-0303-44b5-a246-3f46df74db7d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:42.269984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f5232f2b-0303-44b5-a246-3f46df74db7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:42.272005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:42.386327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:42.542713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:42.544229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:42.688906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54e0c-7f9b-4180-b7d9-86f083455c66 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:42.715866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:42.802130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:42.802729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:42.803009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:42.803276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:42.804857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:42.890769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:42.892362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe744ae-d6c3-47d1-95a7-65eb8acc8724 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:42.910801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 720/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:44.717105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:44.717730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:44.717730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:44.719058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:44.726245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e849-9eef-4da5-9733-b98e848fdcf3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:44.726699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e849-9eef-4da5-9733-b98e848fdcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:44.726809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e849-9eef-4da5-9733-b98e848fdcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:44.767050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:44.793327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d7e5e849-9eef-4da5-9733-b98e848fdcf3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:44.794537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d7e5e849-9eef-4da5-9733-b98e848fdcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:44.887767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:45.171383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:45.172932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:45.277356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5c438-3110-43f7-80dc-767188caa964 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:45.309655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:45.350905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:45.351496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:45.351783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:45.352037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:45.353646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:45.460161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:45.461523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1395cf-047c-4cf3-ac98-5cfdd5d98547 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:45.479054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 722/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:47.530434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:47.531008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:47.531008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:47.532329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:53:47.538481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d401-cf2b-43b1-8d6a-23111c55c251 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:47.538942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d401-cf2b-43b1-8d6a-23111c55c251 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:47.539041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d401-cf2b-43b1-8d6a-23111c55c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:47.603158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8a09d401-cf2b-43b1-8d6a-23111c55c251 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:47.604351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8a09d401-cf2b-43b1-8d6a-23111c55c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:47.616977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:47.700463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:47.990275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:47.991831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:48.093708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473b9d9-1877-444c-a7a6-a4828538ac50 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:48.106890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:48.167699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:48.168222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:48.168496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:48.168763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:48.170461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:48.279256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:48.280681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eab7f-2c88-4aa9-8286-f11c540a26e8 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:48.299461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 723/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:50.569975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:50.570817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:50.570817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:50.572888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:50.578288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1052-818d-40f5-88fd-c0b1cb498e46 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:50.578695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1052-818d-40f5-88fd-c0b1cb498e46 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:50.578845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1052-818d-40f5-88fd-c0b1cb498e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:50.627952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:50.646086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-088c1052-818d-40f5-88fd-c0b1cb498e46 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:50.647289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-088c1052-818d-40f5-88fd-c0b1cb498e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:50.744520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:51.031565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:51.033094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:51.137107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb2707-7069-41f0-88d1-543f201b1330 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:51.178370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:51.211873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:51.212462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:51.212734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:51.212999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:51.214609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:51.321919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:51.323251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf274a5f-701e-443d-8dad-a902556c9d9d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:51.341175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 725/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:53.363247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:53.363778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:53.363778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:53.365035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:53.370343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892469-d693-444d-9939-2ba6fcbd851b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:53.370752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892469-d693-444d-9939-2ba6fcbd851b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:53.370899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892469-d693-444d-9939-2ba6fcbd851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:53.437478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4e892469-d693-444d-9939-2ba6fcbd851b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:53.438740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4e892469-d693-444d-9939-2ba6fcbd851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:53.460503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.539929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:53.823718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:53.825242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:53.928998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880364b-bb3e-46e7-b3d8-7030abb2d39b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:53.948887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:54.002175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:54.003418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:54.003699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:54.003971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:54.005588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:54.113011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:54.114520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdc967-2109-4222-b681-d7c65bde31ed service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:54.133215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 726/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:56.103198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:56.103752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:56.103752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:56.105157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:56.110388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e32ef-8992-456f-8b0b-785d48d7161e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:56.110790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e32ef-8992-456f-8b0b-785d48d7161e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:56.110955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e32ef-8992-456f-8b0b-785d48d7161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:56.177629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:56.180379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0c6e32ef-8992-456f-8b0b-785d48d7161e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:56.182166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0c6e32ef-8992-456f-8b0b-785d48d7161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:56.278214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:56.562414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:56.563933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:56.676120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a780dc-b0cb-4c97-8403-0d7bcfda39f2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:56.725806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:56.750602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:56.751207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:56.751485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:56.751755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:56.754042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:56.866651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:56.868086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38850-10ee-43f6-9d4a-e84e7384f7a3 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:56.886489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 728/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:53:58.844189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:58.844740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:58.844740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:58.846126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:53:58.851773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c5b2-6b05-422c-bff2-3d1e3c329439 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:58.852192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c5b2-6b05-422c-bff2-3d1e3c329439 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:58.852344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c5b2-6b05-422c-bff2-3d1e3c329439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:58.917354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1671c5b2-6b05-422c-bff2-3d1e3c329439 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:53:58.918600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1671c5b2-6b05-422c-bff2-3d1e3c329439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:58.947873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:59.015995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:53:59.304986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:53:59.306608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:59.407341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f759e4b-a066-4cb1-8b65-db628d989d91 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:53:59.435596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:59.480290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:53:59.480885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:53:59.481159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:53:59.481425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:53:59.483009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:53:59.590431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:53:59.591864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d630e1-6fc5-499c-9f82-86d4e598d850 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:53:59.609559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 729/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:01.612624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:01.613154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:01.613252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:01.614560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:01.619735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ea3b-c165-4d55-b217-f3b1740647e3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:01.620138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ea3b-c165-4d55-b217-f3b1740647e3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:01.620295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ea3b-c165-4d55-b217-f3b1740647e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:01.686222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7094ea3b-c165-4d55-b217-f3b1740647e3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:01.687434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7094ea3b-c165-4d55-b217-f3b1740647e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:01.696910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:01.786485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:02.078834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:02.080433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:02.183934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ac77-044f-4db6-8bdd-09bff452de20 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:02.238969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:02.257476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:02.258109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:02.258385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:02.258657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:02.260253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:02.368189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:02.369639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7705e-860c-42b6-92e2-8db2f002953f service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:02.387060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 731/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:04.384803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:04.385356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:04.385356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:04.386752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:04.392469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeeab-5667-40c3-bf34-a1afb75dd1a4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:04.392949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeeab-5667-40c3-bf34-a1afb75dd1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:04.393168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeeab-5667-40c3-bf34-a1afb75dd1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:04.478067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cc1aeeab-5667-40c3-bf34-a1afb75dd1a4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:04.479309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc1aeeab-5667-40c3-bf34-a1afb75dd1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:04.528053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:04.600200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:04.902511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:04.904118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:05.008366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041516-79bc-4aa9-8556-c918366b4b73 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:05.045332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:05.081940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:05.082549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:05.082830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:05.083102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:05.084688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:05.194975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:05.196332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5270e-7e74-4441-9fb7-f109efb5b44f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:05.220321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 732/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:07.140909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313fe7-f75b-462a-a816-738921121392 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:07.141431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313fe7-f75b-462a-a816-738921121392 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:07.141431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e313fe7-f75b-462a-a816-738921121392 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:07.143587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:07.148850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09105-8ec6-4096-b278-41ee91d36a29 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:07.149284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09105-8ec6-4096-b278-41ee91d36a29 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:07.149429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09105-8ec6-4096-b278-41ee91d36a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:07.216334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7dc09105-8ec6-4096-b278-41ee91d36a29 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:07.217569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7dc09105-8ec6-4096-b278-41ee91d36a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:07.235407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:07.316200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:07.609895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313fe7-f75b-462a-a816-738921121392 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:07.612011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8e313fe7-f75b-462a-a816-738921121392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:07.715230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e313fe7-f75b-462a-a816-738921121392 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:07.781431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:07.789605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:07.790208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:07.790486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:07.790757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:07.792349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:07.900854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:07.902345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e51c-93d9-4636-85fc-213526665388 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:07.921257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 734/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:09.848115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:09.848698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:09.848698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:09.850029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:09.855207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e28df-8e38-463d-b225-d86976ce4baf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:09.855668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e28df-8e38-463d-b225-d86976ce4baf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:09.855772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e28df-8e38-463d-b225-d86976ce4baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:09.921205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-511e28df-8e38-463d-b225-d86976ce4baf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:09.922427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-511e28df-8e38-463d-b225-d86976ce4baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:09.972459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:10.140188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:54:10.422231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:10.423746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:10.528086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc333e75-3365-4d2f-889f-a1fa77e133a5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:10.575811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:10.603936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:10.604540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:10.604815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:10.605084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:10.606805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:10.719367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:10.720734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808c1a-f907-47a2-9c46-1ded35c67ac9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:10.739559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 735/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:20.138382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=22 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:20.737183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=66 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:30.396864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a8e0-f1ce-4650-abfc-df2cec2abd48 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:30.397465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a8e0-f1ce-4650-abfc-df2cec2abd48 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:30.397465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5a8e0-f1ce-4650-abfc-df2cec2abd48 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:30.398820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 736/1471] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:30.404192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ebc3-637a-45cd-bdef-1d186cbc635e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:30.404629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ebc3-637a-45cd-bdef-1d186cbc635e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:30.404739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44ebc3-637a-45cd-bdef-1d186cbc635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:30.469987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7a44ebc3-637a-45cd-bdef-1d186cbc635e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:30.471214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7a44ebc3-637a-45cd-bdef-1d186cbc635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:30.568263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 736/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:30.862352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:30.862635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:30.862907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:30.864212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 737/1473] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 31 12:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:30.868994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7c76-e64f-420f-b494-7f8d00796c0c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:30.869277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7c76-e64f-420f-b494-7f8d00796c0c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:30.869580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7c76-e64f-420f-b494-7f8d00796c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:30.945441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-75bc7c76-e64f-420f-b494-7f8d00796c0c None None] MFA Rules not processed for user `03e8d2a225934b7686b885ec53c71ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:30.946663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-75bc7c76-e64f-420f-b494-7f8d00796c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:30.975824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:31.032854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 737/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 31 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:31.040792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:31.042318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:31.145110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e540cc1-d0ef-4250-81f8-1cbc4a32757f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:31.216546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:31.217140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:31.217413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:31.217707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:31.219284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:31.272049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:31.326445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:31.327855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7b35-f67d-4bca-b147-41c6cf9c580f service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:31.345094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 738/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:33.343612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:33.344168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:33.344168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:33.346118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 738/1476] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:33.351245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0165-5584-4471-9221-3dc8d8370df7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:33.351656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0165-5584-4471-9221-3dc8d8370df7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:33.351788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0165-5584-4471-9221-3dc8d8370df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:33.418171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cb1a0165-5584-4471-9221-3dc8d8370df7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:33.419307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb1a0165-5584-4471-9221-3dc8d8370df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:33.516073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 739/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:33.788960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:33.790439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:33.916694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65671547-8de4-4a6f-aa75-a3f52b98fde1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:33.966908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:34.012516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:34.013125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:34.013406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:34.013709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:34.014345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:34.016136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:54:34.016136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:54:34.016136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:54:34.017292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bc3e-fee8-4444-8bfd-312608fe1731 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:34.035951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 739/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 12:54:33 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:54:35.975189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:35.975720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:35.975720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:35.977049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 740/1479] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:35.982173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7dab-0f26-4bd5-9358-eb88d4a4deda None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:35.982615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7dab-0f26-4bd5-9358-eb88d4a4deda None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:35.982719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7dab-0f26-4bd5-9358-eb88d4a4deda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:36.050966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cd4b7dab-0f26-4bd5-9358-eb88d4a4deda None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:36.052158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cd4b7dab-0f26-4bd5-9358-eb88d4a4deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:36.149145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 740/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:36.446322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:36.447935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:36.458597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:36.595152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c33f56-68e5-4fbd-9e93-aafdaebf643f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:36.676751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:36.710902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:36.711425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:36.711701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:36.711968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:36.713576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:36.803326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:36.804896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460dca-2e06-4cb5-bd41-9aebe9883687 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:36.822927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 741/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:38.921220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:38.921220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:38.921220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:38.922393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 741/1482] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:38.928439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc495-d68e-4610-a6b3-53620a45b063 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:38.928855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc495-d68e-4610-a6b3-53620a45b063 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:38.929035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc495-d68e-4610-a6b3-53620a45b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:38.996939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cc3dc495-d68e-4610-a6b3-53620a45b063 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:38.998203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc3dc495-d68e-4610-a6b3-53620a45b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:39.046154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:39.097532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 742/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:39.400234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:39.401808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:39.425253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:39.509460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d7dde-2523-4096-9533-8ee8c58c843f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:39.583168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:39.583766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:39.584049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:39.584317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:39.585935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:39.659311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:39.695751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:39.697187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870f813-e50a-4c6a-8a19-77fe3125b184 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:39.715654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 742/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:41.672256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:41.672785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:41.672785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:41.674291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 743/1485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:41.679568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18719-18f8-4227-a12a-bed1e9cf1ebb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:41.679981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18719-18f8-4227-a12a-bed1e9cf1ebb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:41.680113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18719-18f8-4227-a12a-bed1e9cf1ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:41.746240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-03d18719-18f8-4227-a12a-bed1e9cf1ebb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:41.747431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03d18719-18f8-4227-a12a-bed1e9cf1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:41.841970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 743/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:54:42.128655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:42.130216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:42.237302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5d155-ce3a-4fd9-bb81-c56a9fb4f72d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:42.315920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:42.317732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:42.318498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:42.318943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:42.319268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:42.321114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:42.428874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:42.430221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c63467-1099-4499-9160-5780e3e3030b service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:42.448432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 744/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:44.511677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:44.512245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:44.512245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:44.513737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 744/1488] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:44.519401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f48e-1a87-40e4-8f26-f1800d79bfd7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:44.519946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f48e-1a87-40e4-8f26-f1800d79bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:44.519946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f48e-1a87-40e4-8f26-f1800d79bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:44.584817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-aad0f48e-1a87-40e4-8f26-f1800d79bfd7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:44.586027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aad0f48e-1a87-40e4-8f26-f1800d79bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:44.637546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:44.681681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 745/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:44.976743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:44.978313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:45.014460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:45.083143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff485b-6e25-472e-b724-a9840946c8ea None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:45.157153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:45.158386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:45.158672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:45.158951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:45.160588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:45.241037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:45.272990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:45.274494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22542dde-5b03-4474-9fa5-aa4d717723c8 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:45.293578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 745/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:47.398031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:47.398545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:47.398545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:47.399900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 746/1491] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:54:47.405020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25716f-c2eb-4663-97f0-b7ce8753851d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:47.405413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25716f-c2eb-4663-97f0-b7ce8753851d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:47.405612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25716f-c2eb-4663-97f0-b7ce8753851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:47.471779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fb25716f-c2eb-4663-97f0-b7ce8753851d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:54:47.472991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fb25716f-c2eb-4663-97f0-b7ce8753851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:47.568584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 746/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:54:47.863339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:54:47.864926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:47.967939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b540-b40b-49b2-a261-c71f02d6380e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:54:48.039794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:54:48.040310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:54:48.040584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:54:48.040849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:54:48.042446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:54:48.051785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:48.152570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:54:48.154036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ba106-f6f4-4f9c-9a4c-b44f0a3da1d5 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:54:48.172481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 747/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:54:57.566756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=82 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:58.170338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=50 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:04.880188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:04.881096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:04.881096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:04.956168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:56:04.957366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.051640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 747/1494] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:56:05.059601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:05.060086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:05.060197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:05.135446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:56:05.136565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.230741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 748/1495] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:56:05.235550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:05.236734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.247863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851b5d0-2ef7-4b62-ac34-8339ae52a8b2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:05.310826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:05.345912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:05.346523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:05.346803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:05.347074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:05.347723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:56:05.348026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:05.349034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:05.349034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:56:05.349034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:56:05.349954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:05.360966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 748/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:56:05.369138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:05.378378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a62a-372d-4fd3-b153-e1ecd87c8143 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:05.439278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:05.473218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:05.473838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:05.474111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:05.474376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:05.475014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:05.476706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:05.476706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:56:05.476706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:56:05.477902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:05.535255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 749/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:56:05 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:56:05.539809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:05.541350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.575444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673ffce-3b6f-448d-b9c9-b04dea457d53 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:05.670285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:05.670876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:05.671148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:05.671411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:05.672144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:05.673149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:05.673149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:56:05.673149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:56:05.674378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:05.715683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 749/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:56:05 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:56:05.720135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:05.721681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.783098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadcb0f-1612-490a-817b-4651e0a56aa2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:05.871797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:05.882935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:05.883556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:05.883826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:05.884092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:05.884729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:05.885761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:05.885761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:56:05.885761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:56:05.886632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:05.899422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 750/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:56:05.903522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:05.905065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:05.917172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7a98-8e32-4ca3-9531-608fbe2593e2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:05.943979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:06.014847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:06.015381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.016161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.016661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.017314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:06.018351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:06.018351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:56:06.018351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:56:06.019239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f25284-6da6-402b-add8-f7224a148f2f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:06.031918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 750/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:56:06.036224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:06.037782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:06.070677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fadd25-902d-48d9-8055-fa802a196414 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:06.166595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:06.167250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.167528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.167801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] PATH_INFO: `/v3/projects/e3a52c61acfc4a52a1ece6ec1433c1a0/users/5fa9cec9cb0646dbb2eea348cf560c25/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.189136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a52c61acfc4a52a1ece6ec1433c1a0, user_id=5fa9cec9cb0646dbb2eea348cf560c25, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:06.190211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:06.190211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:56:06.190211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:56:06.192139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914ada-598a-4996-8625-49af0de87875 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:06.217235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 751/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:56:06 2022] PUT /identity/v3/projects/e3a52c61acfc4a52a1ece6ec1433c1a0/users/5fa9cec9cb0646dbb2eea348cf560c25/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:56:06.232255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f9a2-e6a4-4fc2-baa8-c3fe765b2e34 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.232563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f9a2-e6a4-4fc2-baa8-c3fe765b2e34 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.232860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f9a2-e6a4-4fc2-baa8-c3fe765b2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.290008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b083f9a2-e6a4-4fc2-baa8-c3fe765b2e34 None None] MFA Rules not processed for user `5fa9cec9cb0646dbb2eea348cf560c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:56:06.291128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b083f9a2-e6a4-4fc2-baa8-c3fe765b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:06.367471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 751/1502] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:56:06.380977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.381267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.381570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.382888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 752/1503] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 31 12:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:56:06.387632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487259-39fa-4eba-bc6b-144fe82a8a16 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.387911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487259-39fa-4eba-bc6b-144fe82a8a16 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.388181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487259-39fa-4eba-bc6b-144fe82a8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.419788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:06.464290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ac487259-39fa-4eba-bc6b-144fe82a8a16 None None] MFA Rules not processed for user `ce3ffcb22c2e4dfe8d9341d82c8bb716`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:56:06.465576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac487259-39fa-4eba-bc6b-144fe82a8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:06.542770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 752/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 31 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:56:06.553437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:06.554967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:06.604965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:06.660826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58ef34-14be-46c7-a229-bd7f84beb288 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:06.734160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:06.734753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.735032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.735298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.736864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:06.835844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:06.837271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:06.840760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:06.856478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 753/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:56:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:56:06.901127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bbdb-b8b2-4a17-9c46-331cd1ee8775 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:06.901411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bbdb-b8b2-4a17-9c46-331cd1ee8775 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:06.901721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1bbdb-b8b2-4a17-9c46-331cd1ee8775 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:06.902972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 753/1506] 10.222.0.49 () {52 vars in 830 bytes} [Wed Aug 31 12:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:56:06.907126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:06.908325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:07.007979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3230eb-d582-4f2a-8a48-adda39568c84 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:07.108025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:07.108656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:07.108932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:07.109206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] PATH_INFO: `/v3/users/5fa9cec9cb0646dbb2eea348cf560c25` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:07.121456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa9cec9cb0646dbb2eea348cf560c25)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:07.122496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:07.122496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:56:07.122496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:56:07.123699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:07.133897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:07.189214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa9cec9cb0646dbb2eea348cf560c25'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:07.197898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa9cec9cb0646dbb2eea348cf560c25'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:07.220640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa9cec9cb0646dbb2eea348cf560c25'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:07.233855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa9cec9cb0646dbb2eea348cf560c25'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:07.234326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa9cec9cb0646dbb2eea348cf560c25'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:07.239905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 754/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:56:06 2022] DELETE /identity/v3/users/5fa9cec9cb0646dbb2eea348cf560c25 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:56:07.244345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:07.244806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:07.244915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:07.302306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:56:07.303502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:07.378818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:07.392082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 754/1508] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:56:07.402255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:07.403469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:07.503771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fef778-1d8f-411d-a703-242d12443d1a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:07.559808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:07.581639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:07.582248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:07.582518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:07.582781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:07.584355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:07.692055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:07.693365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9922-6410-4827-9beb-255cf66a5673 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:07.711449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 755/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:56:08.106163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:56:08.107740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:56:08.120440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0852-9b29-4380-a105-d662624ffc3b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:56:08.245515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:56:08.246230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:56:08.246747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:56:08.247195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] PATH_INFO: `/v3/projects/e3a52c61acfc4a52a1ece6ec1433c1a0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:56:08.260687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a52c61acfc4a52a1ece6ec1433c1a0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:56:08.261807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:56:08.261807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:56:08.261807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:56:08.263016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:56:08.327611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a52c61acfc4a52a1ece6ec1433c1a0', 'request_id': 'req-b3feec02-0963-4d8c-8a8e-686786b982a1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:08.345589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a52c61acfc4a52a1ece6ec1433c1a0', 'request_id': 'req-b3feec02-0963-4d8c-8a8e-686786b982a1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:08.354251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a52c61acfc4a52a1ece6ec1433c1a0', 'request_id': 'req-b3feec02-0963-4d8c-8a8e-686786b982a1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:08.520013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] The token cache is being invalidate because project e3a52c61acfc4a52a1ece6ec1433c1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:56:08.520434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:08.521328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b3feec02-0963-4d8c-8a8e-686786b982a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:56:08.523542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 755/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:56:08 2022] DELETE /identity/v3/projects/e3a52c61acfc4a52a1ece6ec1433c1a0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:56:17.709212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=62 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:18.516716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:43.216720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:43.217307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:43.217307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:43.218674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:57:43.224200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d266a-5717-4f16-8e7b-f88d6f46b1a2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:43.224616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d266a-5717-4f16-8e7b-f88d6f46b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:43.224758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d266a-5717-4f16-8e7b-f88d6f46b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:43.305957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f23d266a-5717-4f16-8e7b-f88d6f46b1a2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:43.307176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f23d266a-5717-4f16-8e7b-f88d6f46b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:43.408826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:57:43.568219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:57:43.570593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:43.692784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d744d-c674-46b5-9ed0-6e0399267f45 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:57:43.698244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:57:43.698846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:43.699126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:43.699398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:43.708141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:57:43.709742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ae2d-fed2-42dc-a731-c52c5a60913b service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:57:43.719134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 757/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:57:44.559263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2810d1-8d7b-48eb-bec8-2749920039b6 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:44.559683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2810d1-8d7b-48eb-bec8-2749920039b6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:44.559813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2810d1-8d7b-48eb-bec8-2749920039b6 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:44.561173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:57:44.566792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0578a-254c-4114-906c-1665cd505a1e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:44.567228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0578a-254c-4114-906c-1665cd505a1e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:44.567334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0578a-254c-4114-906c-1665cd505a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:44.586470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-36a0578a-254c-4114-906c-1665cd505a1e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:44.587648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-36a0578a-254c-4114-906c-1665cd505a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:44.595597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:57:44.752287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2810d1-8d7b-48eb-bec8-2749920039b6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:57:44.767096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2810d1-8d7b-48eb-bec8-2749920039b6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:57:44.772760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:57:44.773358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:44.773752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:44.774033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:44.782324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:57:44.783907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476d5a8-40c4-4e35-87be-21a0c91aa267 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:57:44.794369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 758/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:57:44.944871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6c33-b5cc-4ec1-a338-af4dc4b8859e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:44.945149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6c33-b5cc-4ec1-a338-af4dc4b8859e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:44.945421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6c33-b5cc-4ec1-a338-af4dc4b8859e None None] PATH_INFO: `/v3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:44.946753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 759/1517] 10.222.0.69 () {54 vars in 925 bytes} [Wed Aug 31 12:57:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:57:44.952963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb5b1-0250-4f89-8360-ed5aaa83fd30 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:44.953246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb5b1-0250-4f89-8360-ed5aaa83fd30 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:44.953539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb5b1-0250-4f89-8360-ed5aaa83fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:45.011640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c81cb5b1-0250-4f89-8360-ed5aaa83fd30 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:45.012818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c81cb5b1-0250-4f89-8360-ed5aaa83fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:45.029720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:45.084408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 759/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Aug 31 12:57:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:57:48.942595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe13df-f076-4c93-b3d4-8162b78de067 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:48.943115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe13df-f076-4c93-b3d4-8162b78de067 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:48.943115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe13df-f076-4c93-b3d4-8162b78de067 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:48.944394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 760/1519] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 31 12:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:57:48.949460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464a03-c399-4efa-a69a-f817699445c1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:48.949915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464a03-c399-4efa-a69a-f817699445c1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:48.950013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6464a03-c399-4efa-a69a-f817699445c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:48.970377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c6464a03-c399-4efa-a69a-f817699445c1 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:48.971525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c6464a03-c399-4efa-a69a-f817699445c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:48.979962 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 760/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 31 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:57:48.988267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe13df-f076-4c93-b3d4-8162b78de067 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:57:49.002225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe13df-f076-4c93-b3d4-8162b78de067 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:57:49.007183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:57:49.007763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:49.008044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:49.008315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:49.016590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:57:49.018192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5ff69-30f9-48a1-9e70-7385925756f6 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:57:49.027791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 761/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:57:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:57:56.005628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c986a-2b88-4874-959c-1f6c2271292f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:56.006200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c986a-2b88-4874-959c-1f6c2271292f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:56.006200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c986a-2b88-4874-959c-1f6c2271292f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:56.007498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:57:56.012406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b1fd-f6b4-4f3b-8370-d55805c45b1e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:56.012813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b1fd-f6b4-4f3b-8370-d55805c45b1e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:56.013016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b1fd-f6b4-4f3b-8370-d55805c45b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:56.033245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cf61b1fd-f6b4-4f3b-8370-d55805c45b1e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:56.034489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf61b1fd-f6b4-4f3b-8370-d55805c45b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:56.042437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:57:56.198534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c986a-2b88-4874-959c-1f6c2271292f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:57:56.213687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c986a-2b88-4874-959c-1f6c2271292f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:57:56.219392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:57:56.219975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:56.220254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:56.220525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:56.228421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:57:56.230024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aa58e-82c6-4b71-9226-f8e89f6b1878 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:57:56.239552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 762/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:57:57.070769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee04e-1eef-4669-974f-f633685f353b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:57.071354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee04e-1eef-4669-974f-f633685f353b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:57.071354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee04e-1eef-4669-974f-f633685f353b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:57.072639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:57:57.077690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8883-ad19-42e2-b731-988ad389d0b9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:57.078140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8883-ad19-42e2-b731-988ad389d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:57.078254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf8883-ad19-42e2-b731-988ad389d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:57.097894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-41cf8883-ad19-42e2-b731-988ad389d0b9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:57:57.099133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-41cf8883-ad19-42e2-b731-988ad389d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:57:57.107000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:57:57.261153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee04e-1eef-4669-974f-f633685f353b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:57:57.276156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee04e-1eef-4669-974f-f633685f353b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:57:57.282268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:57:57.282855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:57:57.283134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:57:57.283437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:57:57.291753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:57:57.293325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8622b2-ec68-4d99-ae2a-564c8193f67e service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:57:57.302813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 764/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:58:00.978941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866b181-c7e5-4a57-a758-28099399caba None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:00.979505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866b181-c7e5-4a57-a758-28099399caba None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:00.979505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866b181-c7e5-4a57-a758-28099399caba None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:00.980831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:58:00.986629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d577-09ea-40e2-a352-9ab50a2cdc02 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:00.987035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d577-09ea-40e2-a352-9ab50a2cdc02 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:00.987179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d577-09ea-40e2-a352-9ab50a2cdc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:01.006920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0823d577-09ea-40e2-a352-9ab50a2cdc02 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:58:01.008120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0823d577-09ea-40e2-a352-9ab50a2cdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:01.016217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:58:01.309222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866b181-c7e5-4a57-a758-28099399caba None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:58:01.310921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4866b181-c7e5-4a57-a758-28099399caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:01.388991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866b181-c7e5-4a57-a758-28099399caba None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:58:01.393182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:58:01.393804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:01.394079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:01.394346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:01.402900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:58:01.404446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0cb99-bfe4-462d-a7a3-9fe4099d2ab9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:58:01.413616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 765/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:58:03.352050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17649-bfe5-4231-af44-3eec9f6ff231 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:03.352609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17649-bfe5-4231-af44-3eec9f6ff231 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:03.352609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17649-bfe5-4231-af44-3eec9f6ff231 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:03.354045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:58:03.359861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724261-ae89-4a5e-b90e-fbbf9b3f3718 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:03.360308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724261-ae89-4a5e-b90e-fbbf9b3f3718 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:03.360452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724261-ae89-4a5e-b90e-fbbf9b3f3718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:03.380244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-40724261-ae89-4a5e-b90e-fbbf9b3f3718 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:58:03.381427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-40724261-ae89-4a5e-b90e-fbbf9b3f3718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:03.389214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:58:03.685921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac17649-bfe5-4231-af44-3eec9f6ff231 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:58:03.697171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac17649-bfe5-4231-af44-3eec9f6ff231 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:58:03.700675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:58:03.701259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:03.701570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:03.701844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:03.711075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:58:03.712488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f5b26-24d4-4026-8f0e-d7aadd805e77 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:58:03.722644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 767/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:58:07.279021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:07.279620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:07.279620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:07.280911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:58:07.286763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e2a9-1660-4403-a321-e501ec971cb7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:07.287216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e2a9-1660-4403-a321-e501ec971cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:07.287319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e2a9-1660-4403-a321-e501ec971cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:07.307465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c4e4e2a9-1660-4403-a321-e501ec971cb7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:58:07.308663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c4e4e2a9-1660-4403-a321-e501ec971cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:07.317158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:58:07.874263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:58:07.876729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:07.941612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:07.955336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6abf5-3ed7-445e-958a-df18e9d55936 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:58:07.958913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:58:07.959518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:07.959793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:07.960062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:07.968979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:58:07.970587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2522edc-0b89-4c59-988f-dd50f6dd3af8 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:58:07.979671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 768/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:58:10.045403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:10.046011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:10.046011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:10.047899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:58:10.053792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1e8b-1fb2-4a62-9ab7-edf571ff6365 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:10.054281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1e8b-1fb2-4a62-9ab7-edf571ff6365 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:10.054405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1e8b-1fb2-4a62-9ab7-edf571ff6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:10.080199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fcdf1e8b-1fb2-4a62-9ab7-edf571ff6365 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:58:10.081397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fcdf1e8b-1fb2-4a62-9ab7-edf571ff6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:10.089132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:58:10.639971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:58:10.641838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:58:10.649878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:10.657923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d776d-0029-4d42-9e19-b17b5eff36f9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:58:10.661610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:58:10.662232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:58:10.662569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:58:10.662847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:58:10.674620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:58:10.676631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99f37b-2441-4ce6-b050-cc2a506d772d service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:58:10.687014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 770/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:58:20.074455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=11 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:20.682290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:40.046463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2077-2719-4f3c-8fe5-2b12463a883e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.047112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2077-2719-4f3c-8fe5-2b12463a883e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.047112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2077-2719-4f3c-8fe5-2b12463a883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.078620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6edd2077-2719-4f3c-8fe5-2b12463a883e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.079905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6edd2077-2719-4f3c-8fe5-2b12463a883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.114508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 770/1540] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.123931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641be3f-6529-494a-b75c-dfd1c7da2279 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.124533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641be3f-6529-494a-b75c-dfd1c7da2279 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.124533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641be3f-6529-494a-b75c-dfd1c7da2279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.144528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.144878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.145131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.171172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7641be3f-6529-494a-b75c-dfd1c7da2279 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.173257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7641be3f-6529-494a-b75c-dfd1c7da2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.190684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.191924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.207691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 771/1541] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.210293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 771/1542] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:40.211836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec43-4b49-438a-aa40-d9949fe8bd19 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.212418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec43-4b49-438a-aa40-d9949fe8bd19 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.212704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aec43-4b49-438a-aa40-d9949fe8bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.223352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.237562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8be0-88fe-49fc-982a-138e543681af None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.250681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.252870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.253383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.253932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.255257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:40.255577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.255716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6a5aec43-4b49-438a-aa40-d9949fe8bd19 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.257037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6a5aec43-4b49-438a-aa40-d9949fe8bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.257553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6bac-1cbb-4f04-830c-884372e08f6c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.276218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 772/1543] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.277128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 772/1544] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:40.277785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce016-7159-435f-a3bb-6cc01a84c636 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.278201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce016-7159-435f-a3bb-6cc01a84c636 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.278725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce016-7159-435f-a3bb-6cc01a84c636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.278840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.279254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.279728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.328651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-041ce016-7159-435f-a3bb-6cc01a84c636 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.329522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.331079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-041ce016-7159-435f-a3bb-6cc01a84c636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.332979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.344930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 773/1545] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.346575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 773/1546] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.347614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.352029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019797c1-0964-4a57-bf99-5f10d4b076d3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.352536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019797c1-0964-4a57-bf99-5f10d4b076d3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.353006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019797c1-0964-4a57-bf99-5f10d4b076d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.364956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44302-a508-4b5e-ad5e-4df4621b6f18 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.372085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.372713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.372994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.373267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.373981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.375018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:40.375018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:59:40.375018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:59:40.376395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb3fbc-8b92-44a3-907b-60b04ab4bf42 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.385917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-019797c1-0964-4a57-bf99-5f10d4b076d3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.387164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-019797c1-0964-4a57-bf99-5f10d4b076d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.396736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 774/1547] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.397956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.398239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.398513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.429910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 774/1548] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:40.430362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.431733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.432940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbdeb-35db-4d83-bbec-2f283f9f320a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.433498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbdeb-35db-4d83-bbec-2f283f9f320a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.433943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbdeb-35db-4d83-bbec-2f283f9f320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.457589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2c3cbdeb-35db-4d83-bbec-2f283f9f320a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.459098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2c3cbdeb-35db-4d83-bbec-2f283f9f320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.512363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 775/1549] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.513474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.525538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f326-5195-45b9-bd89-8cb770bd6bc5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.530620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.531304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.531623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.531894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.532732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:40.533036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.534856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:40.534856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:59:40.534856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:59:40.535744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3fd19-8bba-48c3-b6a7-a30493147fd6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.549917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 776/1550] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:40.551265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614515-900b-41d6-af2d-52af57e3278d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.551558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614515-900b-41d6-af2d-52af57e3278d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.551693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 775/1551] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.551872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614515-900b-41d6-af2d-52af57e3278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.553280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.553611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.553893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.574038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bc614515-900b-41d6-af2d-52af57e3278d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.575306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bc614515-900b-41d6-af2d-52af57e3278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.575433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.576480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.584359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 777/1552] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.585604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9f1c-47ec-4642-96fb-bcfdd411d8d4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.585741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.585926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9f1c-47ec-4642-96fb-bcfdd411d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.586170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9f1c-47ec-4642-96fb-bcfdd411d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.586513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.597673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3719-09bd-4170-8258-9bbf87553a95 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.603090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.603714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.603994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.604268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.604920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.606943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.611601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0a0e9f1c-47ec-4642-96fb-bcfdd411d8d4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.613473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0a0e9f1c-47ec-4642-96fb-bcfdd411d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.621615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.622874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.623149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.623426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.634831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 777/1555] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:40.635751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.646050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.647339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.655475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.655679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab85b4c-b04e-45fd-b991-0c0f1674a568 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.656269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.664065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.665070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.665593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.666052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.666855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c8e3-f0b9-4a8f-bce2-51b6b5171176 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.667195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:40.667705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.670995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19fcb-826b-49f8-86fb-3d01d4accf37 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.675835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.676484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.676908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.677330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.678375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.681721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.685673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:40.686940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef5df-1181-4bae-afb2-6ebb44b4b527 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.687239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef5df-1181-4bae-afb2-6ebb44b4b527 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.687509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef5df-1181-4bae-afb2-6ebb44b4b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.714426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6edef5df-1181-4bae-afb2-6ebb44b4b527 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.716533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6edef5df-1181-4bae-afb2-6ebb44b4b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.725539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 780/1558] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:40.725539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.729876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.732336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.732336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.732336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.754142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.755847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.798339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284898c-1d2c-4942-b05d-e9d7ca1f3107 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.805793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.806585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.807035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.807315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.808125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:40.808428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.809081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:40.810082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.824376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:40.825310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.828364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.830285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.847741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed267814-fe0e-4f09-81df-1ae4b02717bd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.848961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593bae8-3624-43bd-ae06-d26bd5af2af2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.852562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.853167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.853450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.853744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.854372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.854523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:40.854706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.854993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.855274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.855548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.856229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.856333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.858048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cb73e-410b-49df-9896-5dd5c863afcc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.870232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 781/1562] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:40.871511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.871794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.872064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.875580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:40.881729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 782/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:40.882661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.899199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d3d9-4074-4e7c-af71-9278d1362ce1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.901338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:40.902586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:40.905881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.906898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.907367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.907813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.908831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.911005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.911495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 782/1564] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:40.912306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.922304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819053c-6a09-4180-8e79-64d538fbec66 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:40.927695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:40.928353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:40.928664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:40.928934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:40.929607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:40.931573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:40.947271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 783/1565] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:40.948625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.964188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 783/1566] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:40 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:40.965411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:40.978863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5520e-16b3-4181-81ae-ced17d7ecba1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.039592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639340-df1a-4bca-a40c-9f9cf5e96524 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.045664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.046292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.046600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.046832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.047536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:41.047830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.050204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.073558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 784/1567] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:41.073816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.073816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.073816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.074840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.075036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.075036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:41.075036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.075036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.086228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 784/1568] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:41.086476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230dff-1fe0-45c1-9b12-a66eea0aec93 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.087396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.095745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.096666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.097067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.097362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.098151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.099253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139bc15-05c0-4159-8ced-838feb04da65 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.100103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.106446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.107075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.107353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.107702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.108267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.109903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.122090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 785/1569] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.122773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.133780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 785/1570] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.134728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.144584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f064-01a0-4da4-aaba-aa311fa02627 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.213681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4e24e-b721-4bbe-ae42-5d717067d0ef admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.218939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.219543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.219816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.220108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.220738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:41.221100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.222836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.225127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.225839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.226231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.226671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.227434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.229724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.240308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 786/1571] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:41.241218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.251415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc934-3c14-4009-a42b-69116ac6936d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.258674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.259781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.260076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.260351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.261000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.262066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:41.262066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:59:41.262066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:59:41.263286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.268969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 786/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.269802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.291349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 787/1573] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.291349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.302750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc611-4704-446d-a4c6-dac2e50c73a1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.307350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:41.332451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:41.348842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4657c-7ece-472e-bc17-7a78461d4dc3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.354458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.355145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.355354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.355666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.356324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.358221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.372202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 787/1574] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.372912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.373172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.373845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.374168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.374447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.375117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.377633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.386508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a213-2a89-4524-a21c-65836c9e00f3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.391566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.392219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.392677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.393016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.394039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.395963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.415435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 788/1575] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.416913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.429155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 788/1576] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.430424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.494274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a027-eccb-43d4-b07f-5dabca03148a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.497871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c4c92-fa91-4ab9-94e9-6e643966d7ca admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.498929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.499672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.500013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.500293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] PATH_INFO: `/v3/projects/1ebc839418574d87b98c828b3b1cbf33/users/e8a9079515ec45e2b8ed94e848ffcf6e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.502701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.503309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.503586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.503876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.504504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.506477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.520814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebc839418574d87b98c828b3b1cbf33, user_id=e8a9079515ec45e2b8ed94e848ffcf6e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.523539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.531131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 789/1577] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.532438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.546602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 789/1578] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:41 2022] PUT /identity/v3/projects/1ebc839418574d87b98c828b3b1cbf33/users/e8a9079515ec45e2b8ed94e848ffcf6e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:41.546602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.553886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a05b4-3dda-45f2-a5eb-17393b4d842f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.613465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bbe18-bec3-4fef-83cb-8da832e7d760 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.619878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.620592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.621042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.621445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.622540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.624855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.630921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.631587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.631943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.632216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.633126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.636409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.648505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 790/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.651831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.664632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b57a17-5c7c-4b81-a805-7b4814ab7cad admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.670147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.670811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.671097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.671354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.672041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.674614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.674929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 790/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.676499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.688452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 791/1581] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.689294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.701241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:41.702016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9f6b-e233-420b-8bbe-3016b9f31bb9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.721594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:41.757286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5614-83c0-41f5-aff4-7194b654c47b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.762033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.762657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.762937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.763201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.763845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.765453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.782569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 791/1582] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.782569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.782898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.783850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.783850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.784653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.785302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.788080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.792302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ade-8f2a-4393-9768-c7da49592b66 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.797008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.797673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.797983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.798266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.798989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.801249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167bbed-38f2-4a8c-a271-d875ace6ee0d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.819437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 792/1583] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.820751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.827977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 792/1584] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 285 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.829496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.829982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.830905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.835249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e4339-4c9e-4c27-9929-86d2f3aeb08a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.841468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.842116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.842403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.842677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.843543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.845299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.854740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:41.856053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:41.868879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 793/1586] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:41.869147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 793/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.869907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.870825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.885693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf46aff-7689-4417-bbf3-1cdd97073f70 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.886530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be1f4-2e8c-4093-8e13-966d27a03d44 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.892679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.893129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.893651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.893956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.894201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.894345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.894507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.894987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.895146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.895684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.896696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.897619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.916748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 794/1587] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.918081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.932102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 794/1588] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:41 2022] POST /identity/v3/users => generated 302 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:41.932418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.932549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51931e-b077-4d1d-ab98-ddd103fd8d72 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.941795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.942456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.942731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.943005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.943705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.945383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.948337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2e10-0bbd-4e04-be5f-86a97ff4ab04 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.952594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.953260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.953568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.953846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] PATH_INFO: `/v3/projects/92db9b9ce7d44b3596f44a6984c794d8/users/d2292379507f425aa217920f15aba22d/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.957145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 795/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.958445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.969475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab0a-7186-4acd-af27-b1a24ec07708 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:41.975352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:41.976142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:41.976530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:41.976982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:41.977810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.979416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92db9b9ce7d44b3596f44a6984c794d8, user_id=d2292379507f425aa217920f15aba22d, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:41.979682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.982645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:41.994564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 796/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:41.995831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:41.999298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 795/1591] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:41 2022] PUT /identity/v3/projects/92db9b9ce7d44b3596f44a6984c794d8/users/d2292379507f425aa217920f15aba22d/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.000111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.010001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6249ab-5e76-4779-b3fd-012d644a5f09 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.070741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.071575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.072007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.072599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.073260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.074892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.076236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87ace-fcb5-46e6-aef9-74e0c0294fe1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.081338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.082336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.082785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.083087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.083747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.085589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.086278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 797/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.087170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.088990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:42.105022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 796/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.105022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.119711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e7cf-4b43-4390-81a1-9d6d9d414599 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.125700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.126312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.126586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.126855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.127853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.129454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.142684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 797/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.144432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.155447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce026-9a5f-4023-8e03-f0b0bba1ebfd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.162192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.162951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.163657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.164140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.165078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.167843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.171367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1af43-2868-443e-b827-e59804309e53 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.176146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.176898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.177222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.177689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.184464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 798/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.185116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.187609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:42.189323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.192241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.200132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff846a-85e8-4e72-af4c-d49259f48ecd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.203220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 798/1596] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:42.203933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.207207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.208231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.208702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.209168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] PATH_INFO: `/v3/projects/c11e3437e93946f8acd31f37a9974d1c/users/b0dc5717680e45268974b5912e8c7308/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.214990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c331-22c4-400c-b459-768b1264aae4 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.220273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.221394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.221706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.222092 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.222751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.224365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff3d0-5336-4c4d-8397-f090d3e9cb0e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.231737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11e3437e93946f8acd31f37a9974d1c, user_id=b0dc5717680e45268974b5912e8c7308, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.234449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.238678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 799/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.240342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.240784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.241063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.253296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:42.268759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 799/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/c11e3437e93946f8acd31f37a9974d1c/users/b0dc5717680e45268974b5912e8c7308/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.268759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.274243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:42.275761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:42.354070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 800/1599] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:42.354070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.374201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfab1-a947-43fd-a899-e3470279b02a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.381939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506b787-cd25-44b3-837c-0f24eafab382 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.383622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.384853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.385993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.386477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] PATH_INFO: `/v3/projects/35c0326864704f418995ef3b7a6269f5/users/20d7ffc4385842b6bd380b65c7ca1507/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.387939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.388533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.388804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.389072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.389739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.391457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.405815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 800/1600] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.407054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.417381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c0326864704f418995ef3b7a6269f5, user_id=20d7ffc4385842b6bd380b65c7ca1507, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.419317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:42.419317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:59:42.419317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:59:42.422581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477cb0-3292-43fd-a23b-081269fe2e91 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.423198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.429056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.430056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.430286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.430652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] PATH_INFO: `/v3/projects/2557b4276b764606956af532cd04f79c/users/af3f4441d96c4343b655b13d60eed759/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.450885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2557b4276b764606956af532cd04f79c, user_id=af3f4441d96c4343b655b13d60eed759, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.453700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.454498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 801/1601] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/35c0326864704f418995ef3b7a6269f5/users/20d7ffc4385842b6bd380b65c7ca1507/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.462809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.476367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 801/1602] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/2557b4276b764606956af532cd04f79c/users/af3f4441d96c4343b655b13d60eed759/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.476367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.593341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61cc6-f29e-45d6-8ab3-1e91a0639048 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.595450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61f879-538e-474f-9bd7-5d6650913b1d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.599236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.600124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.600498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.600782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.601847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.604125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33250dc4-6f6e-44ce-b43c-31c0c1256346 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.609140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.610211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.610665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.611115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] PATH_INFO: `/v3/projects/97ebdb8d60f64982b36bb2f28b222b2f/users/3dcaaed0f359443b95a53895bd5c7750/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.628019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 802/1603] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:42.631886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.633279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.633279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.644320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ebdb8d60f64982b36bb2f28b222b2f, user_id=3dcaaed0f359443b95a53895bd5c7750, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.648390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.665383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:42.677511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 802/1604] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/97ebdb8d60f64982b36bb2f28b222b2f/users/3dcaaed0f359443b95a53895bd5c7750/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.677752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:42.677879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.745609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:42.761646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891d2a-29b7-41b1-9c3f-20ce7b27cfa5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.766641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 803/1605] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:42.768197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.785355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.786543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.787184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.787761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.790777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78133b9-8493-45e0-851b-199d9b70e7d1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.801421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.802192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.803321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.803606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] PATH_INFO: `/v3/projects/195c90161d6d45cfad834acc6a91299e/users/a0fb3cfbdc8c4e59b26142c5a60ba8f0/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.804073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.806685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4122-2761-4867-be84-9160f5ea73a9 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.815960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:42.828168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 803/1606] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:42.829519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.829813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.830097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.830928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195c90161d6d45cfad834acc6a91299e, user_id=a0fb3cfbdc8c4e59b26142c5a60ba8f0, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:42.834741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45dec-f30d-46ad-9ad2-3345c89ca927 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:42.858282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 804/1607] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/195c90161d6d45cfad834acc6a91299e/users/a0fb3cfbdc8c4e59b26142c5a60ba8f0/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:42.859145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:42.860615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:42.872597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6651-7913-41f8-be45-fc3c79554b27 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.872881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6651-7913-41f8-be45-fc3c79554b27 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.873146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6651-7913-41f8-be45-fc3c79554b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:42.908835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c47a6651-7913-41f8-be45-fc3c79554b27 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:42.911482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c47a6651-7913-41f8-be45-fc3c79554b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:42.971369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 804/1608] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:42.973159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:42.985786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e011d-8140-4bc3-b0a1-e67ee16b9ad5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:42.991840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:42.992534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:42.992809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:42.993086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] PATH_INFO: `/v3/projects/24608f780abb48d6978d8faa99c3aeff/users/8cb916ffba2d42eb8fc40b40a5276803/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.014123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=24608f780abb48d6978d8faa99c3aeff, user_id=8cb916ffba2d42eb8fc40b40a5276803, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.017727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.033111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 805/1609] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:43.037087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ea3-07e6-4727-aabd-674410515fdb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.045991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ea3-07e6-4727-aabd-674410515fdb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.046605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ea3-07e6-4727-aabd-674410515fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.061875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 805/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:42 2022] PUT /identity/v3/projects/24608f780abb48d6978d8faa99c3aeff/users/8cb916ffba2d42eb8fc40b40a5276803/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:43.061875 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.101018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5ab11ea3-07e6-4727-aabd-674410515fdb None None] MFA Rules not processed for user `3dcaaed0f359443b95a53895bd5c7750`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:43.102602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ab11ea3-07e6-4727-aabd-674410515fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:43.160812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dece58-cbfc-44f2-a8c9-0bdbb0fee3de admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.166209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.166892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.167233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.167701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.192673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 806/1611] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:43.197551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ab2a-9abd-411f-aa92-6f8148506162 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.197551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ab2a-9abd-411f-aa92-6f8148506162 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.197551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91ab2a-9abd-411f-aa92-6f8148506162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.244973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9c91ab2a-9abd-411f-aa92-6f8148506162 None None] MFA Rules not processed for user `a0fb3cfbdc8c4e59b26142c5a60ba8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:43.246544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c91ab2a-9abd-411f-aa92-6f8148506162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:43.270119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.271647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.292168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 806/1612] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:43.294756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.307796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd924-3142-409a-95e8-53189771de76 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.314120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.318560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.319399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.319814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.331000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:43.340920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.342612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.357768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 807/1613] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:43.358650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.368698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49283345-870a-42dc-81d1-c213a11ea14a service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.373388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.374064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.374315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.374585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.380213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 807/1614] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:43.384522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.384522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.384680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.394212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.395751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3cfd2-3eab-4dfc-baaa-8551f799ee7e service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.400195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:43.409020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 808/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:43.411701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188162-6daf-437d-b3c2-2045da31d91f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.414285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188162-6daf-437d-b3c2-2045da31d91f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.414285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188162-6daf-437d-b3c2-2045da31d91f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.415768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 809/1616] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 12:59:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:59:43.422467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188162-6daf-437d-b3c2-2045da31d91f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.437310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] MFA Rules not processed for user `8cb916ffba2d42eb8fc40b40a5276803`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:43.439262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:43.449257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188162-6daf-437d-b3c2-2045da31d91f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.461161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.463325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.463804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.464517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.465368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.469413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfad5b-8d31-4fc3-a95e-a56a476466af admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.538706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 810/1617] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:43.540724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.544723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.545057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.549252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 808/1618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:43.551532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.587210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce05c-e5f9-4c4f-83e8-b25b964dd3ca None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.632274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:43.637031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:43.776122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.778191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 811/1619] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:43.781525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.791020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.791314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.791587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.795160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.798295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.839629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e85ae-64b2-4bed-8e88-f2600a7a4e77 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.859014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 809/1620] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:43.859231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.860342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.860828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.862056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.864207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:43.864505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:43.869884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:43.885076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc123f-b83d-4a84-8279-d4f7e0ddbb7f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:43.892204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:43.893048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:43.894303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:43.894303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:43.935197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 812/1621] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:43 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:43.936132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.009365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.013470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.027835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 810/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:44.028972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.049826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31adc-252c-4f70-b5cc-3ff278d219e2 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.057234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:44.084368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d043dc-6647-4a3a-8999-99c77ecf60b4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.096762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.097523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.097816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.098086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.098746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.100372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.121847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 813/1623] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:44.125900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.146028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35d5b-1614-4553-907e-dd5417cafc12 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.158079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.158829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.159111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.159389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] PATH_INFO: `/v3/projects/76f7d40334c84dbdb930548a3d0e0238/users/b79fa9d55e19473db11729f383a063ea/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.161512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.162445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.162816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.163182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.164324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.166654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.194533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f7d40334c84dbdb930548a3d0e0238, user_id=b79fa9d55e19473db11729f383a063ea, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.198744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.210288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 811/1624] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:44 2022] POST /identity/v3/users => generated 309 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:44.212289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.224588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1955-b30c-414e-a8c6-2299fd15ff6e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.225895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 814/1625] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:44 2022] PUT /identity/v3/projects/76f7d40334c84dbdb930548a3d0e0238/users/b79fa9d55e19473db11729f383a063ea/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:59:44.229764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.245971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:44.374439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64183-eeb7-4b52-b6e4-e4cc47495c4f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.380046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.381385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.381718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.382530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.383650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.385454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.385937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.388787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.389580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.390751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.392775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.397099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d71bab-83d2-4486-936e-0aa73950dd82 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.426437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 812/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:44.427744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.434661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 815/1627] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:59:44.437210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3bb3-a256-463c-8bb3-a362098f5577 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.437210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3bb3-a256-463c-8bb3-a362098f5577 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.437210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3bb3-a256-463c-8bb3-a362098f5577 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.441748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 816/1628] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 12:59:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:59:44.445776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e3bb3-a256-463c-8bb3-a362098f5577 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.452869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc82720-40ee-4b49-8876-38027aa0df39 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.469620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.470121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e3bb3-a256-463c-8bb3-a362098f5577 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.472676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.473751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.475727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] PATH_INFO: `/v3/projects/b4561f976e5c4d519fd092df47eb3cc2/users/87ce268b94884212825ddfe501133aff/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.477531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.478511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.478983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.479588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] PATH_INFO: `/v3/projects/76f7d40334c84dbdb930548a3d0e0238/users/b79fa9d55e19473db11729f383a063ea/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.482159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f7d40334c84dbdb930548a3d0e0238, user_id=b79fa9d55e19473db11729f383a063ea, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.485246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616817f9-55a8-47ec-9b7e-1751ba1c45ae admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.508983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 817/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:44 2022] PUT /identity/v3/projects/76f7d40334c84dbdb930548a3d0e0238/users/b79fa9d55e19473db11729f383a063ea/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:44.510889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.511363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.511835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.515675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4561f976e5c4d519fd092df47eb3cc2, user_id=87ce268b94884212825ddfe501133aff, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.522618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858bb09-7946-430c-ab1d-26474e879928 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.536241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:44.538898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:44.560089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 813/1630] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:44 2022] PUT /identity/v3/projects/b4561f976e5c4d519fd092df47eb3cc2/users/87ce268b94884212825ddfe501133aff/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:44.562171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.563505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.563621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.652481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] MFA Rules not processed for user `b79fa9d55e19473db11729f383a063ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:44.658707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:44.665046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 818/1631] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:44.666691 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.831693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:44.854874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 814/1632] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:44.856800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.876130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b13f-bca5-4718-865f-48feb96741d7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:44.882658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:44.883668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:44.884102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:44.884523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:44.885539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:44.887582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:44.906189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 819/1633] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:44.907464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:44.967411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:44.999764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d469-579e-45da-9427-6b1c2ceb21cd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:45.007139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:45.008009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:45.008517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:45.008895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:45.050992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:45.057985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:45.079057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6e349-45f6-4a64-9b07-77a9a555603f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:45.088643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:45.089742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:45.094446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:45.094446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:45.101721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 815/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:45.104940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:45.138910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:45.145288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1716-b87d-4648-87d7-07a714384f71 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:45.146363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b2db-fb90-4664-8eb8-02d2cf7b8986 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:45.164060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:45.164888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:45.165458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:45.165893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] PATH_INFO: `/v3/projects/b4561f976e5c4d519fd092df47eb3cc2/users/87ce268b94884212825ddfe501133aff/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:45.170825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4561f976e5c4d519fd092df47eb3cc2, user_id=87ce268b94884212825ddfe501133aff, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:45.178774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:45.191387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 820/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:45.211682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 816/1636] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:45 2022] PUT /identity/v3/projects/b4561f976e5c4d519fd092df47eb3cc2/users/87ce268b94884212825ddfe501133aff/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:45.224845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:45.225908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:45.226359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:45.283709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] MFA Rules not processed for user `87ce268b94884212825ddfe501133aff`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:45.285384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:45.449990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 821/1637] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:45.479244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:45.631023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff3bd6-8440-4e3b-953e-f43a0700a658 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:45.636685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:45.638001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:45.638286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:45.638561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:45.660239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:45.662481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:45.679264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 817/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:46.271360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:46.532269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b878c3-345d-4455-8e71-d88e0c9dd68e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:46.556687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:46.557360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:46.557673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:46.557952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] PATH_INFO: `/v3/users/8cb916ffba2d42eb8fc40b40a5276803` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:46.566448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb916ffba2d42eb8fc40b40a5276803)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:46.568402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:46.695849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:46.703910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb916ffba2d42eb8fc40b40a5276803'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:46.720854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb916ffba2d42eb8fc40b40a5276803'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:46.742378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb916ffba2d42eb8fc40b40a5276803'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:46.748308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:46.755883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb916ffba2d42eb8fc40b40a5276803'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:46.757656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-60e7b290-8ca3-477a-a16c-eb8483c5b49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb916ffba2d42eb8fc40b40a5276803'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:46.772692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 822/1639] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:59:46 2022] DELETE /identity/v3/users/8cb916ffba2d42eb8fc40b40a5276803 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:46.777532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:46.778118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:46.778563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:46.785580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80668cc-4005-446a-a731-62387843fc01 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:46.805573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:46.807130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:46.939203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 823/1640] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:46.952436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:46.953422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:46.953908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:46.954315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] PATH_INFO: `/v3/users/a0fb3cfbdc8c4e59b26142c5a60ba8f0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:46.957521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fb3cfbdc8c4e59b26142c5a60ba8f0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:46.959871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:46.959871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: warnings.warn(msg) Aug 31 12:59:46.959871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: Aug 31 12:59:46.962164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:46.970396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:46.972524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.083949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:47.123090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ccdb0-d900-40d0-94be-08e42891edc5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:47.127899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fb3cfbdc8c4e59b26142c5a60ba8f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:47.135739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:47.136632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.136917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.137187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.145301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fb3cfbdc8c4e59b26142c5a60ba8f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:47.148937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fb3cfbdc8c4e59b26142c5a60ba8f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:47.157602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:47.160407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bdff1-3560-411d-ac0f-4752b0074c6e service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:47.174480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 824/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:59:47.176051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4da5-99b7-4f33-b1f5-683322a07119 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.176335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4da5-99b7-4f33-b1f5-683322a07119 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.176610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4da5-99b7-4f33-b1f5-683322a07119 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.178501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 825/1642] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:59:47.188323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cab6f-3802-4138-911b-feecabd66009 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.190699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cab6f-3802-4138-911b-feecabd66009 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.191765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cab6f-3802-4138-911b-feecabd66009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.225843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fb3cfbdc8c4e59b26142c5a60ba8f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:47.254418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-240cab6f-3802-4138-911b-feecabd66009 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:47.255428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-240cab6f-3802-4138-911b-feecabd66009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.262251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e85d7051-32a4-4933-a6f8-4c2516092a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fb3cfbdc8c4e59b26142c5a60ba8f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:47.278695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 818/1643] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:59:46 2022] DELETE /identity/v3/users/a0fb3cfbdc8c4e59b26142c5a60ba8f0 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:47.283452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.283755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.284020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.332884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:47.335411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.402093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:47.428699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 826/1644] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:47.437813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a100bc2-7d62-4d88-b1ed-743ee6c11abd None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.438115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a100bc2-7d62-4d88-b1ed-743ee6c11abd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.438393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a100bc2-7d62-4d88-b1ed-743ee6c11abd None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.440671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 827/1645] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 12:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:59:47.450213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.450490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.450762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.486707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:47.488611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 819/1646] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:47.494809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.577414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:47.579069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.647173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 828/1647] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:47.697707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:47.699563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:47.716257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f5eec-fd07-4533-8bee-b4bd7cbe4a79 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:47.726644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:47.727323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.727662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.729521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.753241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:47.755426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:47.784041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 820/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:59:47.827177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b025-4f6c-4c84-aa3b-0b9262070bd6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:47.832500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:47.833444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:47.834128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:47.834644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:47.855345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:47.860397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:47.896173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 829/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:59:48.593783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:48.596476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:48.626350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120499f1-3b47-4542-8421-4c0ffa354e4f service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:48.651884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:48.652512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:48.652794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:48.653062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] PATH_INFO: `/v3/projects/24608f780abb48d6978d8faa99c3aeff` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:48.658246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24608f780abb48d6978d8faa99c3aeff)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:48.662161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:48.773450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:48.776693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24608f780abb48d6978d8faa99c3aeff', 'request_id': 'req-587b26a8-e6d3-4164-9613-a348e9286444'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:48.786762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24608f780abb48d6978d8faa99c3aeff', 'request_id': 'req-587b26a8-e6d3-4164-9613-a348e9286444'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:48.804431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24608f780abb48d6978d8faa99c3aeff', 'request_id': 'req-587b26a8-e6d3-4164-9613-a348e9286444'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:48.831741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] The token cache is being invalidate because project 24608f780abb48d6978d8faa99c3aeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:59:48.832280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:48.833263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:48.840779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 821/1650] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:59:48 2022] DELETE /identity/v3/projects/24608f780abb48d6978d8faa99c3aeff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:48.842376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:48.858629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de329c-666e-450f-8630-b48d2e4c61fd service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:49.004847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:49.005737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:49.006027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:49.006430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] PATH_INFO: `/v3/users/87ce268b94884212825ddfe501133aff` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:49.007795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ce268b94884212825ddfe501133aff)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:49.009805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:49.157936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:49.193283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ce268b94884212825ddfe501133aff'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:49.211429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ce268b94884212825ddfe501133aff'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:49.259519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ce268b94884212825ddfe501133aff'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:49.291997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ce268b94884212825ddfe501133aff'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:49.292804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ce268b94884212825ddfe501133aff'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:49.313340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 830/1651] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:59:48 2022] DELETE /identity/v3/users/87ce268b94884212825ddfe501133aff => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:49.872656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:49.879041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:49.957367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b26a8-e6d3-4164-9613-a348e9286444 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:50.238024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:50.238024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:50.238024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:50.238024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] PATH_INFO: `/v3/projects/195c90161d6d45cfad834acc6a91299e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:50.241266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195c90161d6d45cfad834acc6a91299e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:50.243549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:50.414218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195c90161d6d45cfad834acc6a91299e', 'request_id': 'req-b000df25-54a7-4887-8fc1-844fef7013f6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.426912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195c90161d6d45cfad834acc6a91299e', 'request_id': 'req-b000df25-54a7-4887-8fc1-844fef7013f6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.435752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195c90161d6d45cfad834acc6a91299e', 'request_id': 'req-b000df25-54a7-4887-8fc1-844fef7013f6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.491622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] The token cache is being invalidate because project 195c90161d6d45cfad834acc6a91299e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:59:50.492089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.492913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.511584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 822/1652] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:59:49 2022] DELETE /identity/v3/projects/195c90161d6d45cfad834acc6a91299e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:50.512713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:50.514319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:50.551685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dee70-c5ac-489c-8474-ace5ba87703d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:50.722368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:50.723345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:50.724196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:50.724654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] PATH_INFO: `/v3/users/b79fa9d55e19473db11729f383a063ea` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:50.726423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79fa9d55e19473db11729f383a063ea)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:50.733109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:50.862646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79fa9d55e19473db11729f383a063ea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.889051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79fa9d55e19473db11729f383a063ea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.913612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79fa9d55e19473db11729f383a063ea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.928777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79fa9d55e19473db11729f383a063ea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.930059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79fa9d55e19473db11729f383a063ea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:50.942211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 831/1653] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:59:50 2022] DELETE /identity/v3/users/b79fa9d55e19473db11729f383a063ea => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:59:51.978229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:51.979750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:52.009191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000df25-54a7-4887-8fc1-844fef7013f6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:52.197938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:52.198910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.199350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.199800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] PATH_INFO: `/v3/users/3dcaaed0f359443b95a53895bd5c7750` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.214495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcaaed0f359443b95a53895bd5c7750)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:52.229986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:52.245410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:52.292069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:52.294077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:52.317786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88cb-f429-499c-86a9-05e72c0519b4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:52.336123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:52.336782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.337633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.337633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] PATH_INFO: `/v3/projects/b4561f976e5c4d519fd092df47eb3cc2` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.341332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4561f976e5c4d519fd092df47eb3cc2)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:52.342560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:59:52.342560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: warnings.warn(msg) Aug 31 12:59:52.342560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: Aug 31 12:59:52.343927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:52.356068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcaaed0f359443b95a53895bd5c7750'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.380275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcaaed0f359443b95a53895bd5c7750'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.381396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcaaed0f359443b95a53895bd5c7750'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.410476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcaaed0f359443b95a53895bd5c7750'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.428872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b38747ff-d0af-48b0-8455-feca206c29a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcaaed0f359443b95a53895bd5c7750'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.443429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 823/1654] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 12:59:51 2022] DELETE /identity/v3/users/3dcaaed0f359443b95a53895bd5c7750 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:52.445647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:52.446183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c1b-305d-4e2b-9d25-312ed3bc82d9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.447663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c1b-305d-4e2b-9d25-312ed3bc82d9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.448351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9c1b-305d-4e2b-9d25-312ed3bc82d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.498220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-249c9c1b-305d-4e2b-9d25-312ed3bc82d9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:52.500933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-249c9c1b-305d-4e2b-9d25-312ed3bc82d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:52.543500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4561f976e5c4d519fd092df47eb3cc2', 'request_id': 'req-fe23ce55-da9d-4fd3-8e91-bab974c08f74'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.572068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4561f976e5c4d519fd092df47eb3cc2', 'request_id': 'req-fe23ce55-da9d-4fd3-8e91-bab974c08f74'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.613999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 824/1655] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:52.638511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4561f976e5c4d519fd092df47eb3cc2', 'request_id': 'req-fe23ce55-da9d-4fd3-8e91-bab974c08f74'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.672238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] The token cache is being invalidate because project b4561f976e5c4d519fd092df47eb3cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:59:52.672541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.674740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe23ce55-da9d-4fd3-8e91-bab974c08f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:52.679586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 832/1656] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:59:52 2022] DELETE /identity/v3/projects/b4561f976e5c4d519fd092df47eb3cc2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:59:52.681970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e549-bd26-4817-914a-13933832ae48 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.682811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e549-bd26-4817-914a-13933832ae48 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.683337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e549-bd26-4817-914a-13933832ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.742775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3454e549-bd26-4817-914a-13933832ae48 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:52.745025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3454e549-bd26-4817-914a-13933832ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:52.789762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 825/1657] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:52.794530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.794837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.795114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.848638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:52.852165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:52.885720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 833/1658] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:52.887310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e549-bd26-4817-914a-13933832ae48 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:52.907003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e549-bd26-4817-914a-13933832ae48 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:52.927595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:52.927845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:52.928446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:52.928828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:52.929856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:52.930291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:52.932352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.002894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 826/1659] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:53.003751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.021132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730dca-5b07-42ef-84b5-5209e4663a5e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.035618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.036773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.037278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.038738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.039541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.042971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.135575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 834/1660] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:53 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:59:53.139867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.174233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7eac-0710-45e2-8606-627888310cda admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.224387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.226749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:53.329435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.330711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.331257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.331257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.331903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.342439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.352804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306da1ba-e6ee-4b3a-8928-8bc19a85a660 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.356830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.358411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.358802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.359417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.362811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:53.367319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:53.386448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 827/1661] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:53 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:53.392606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.396962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.398797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.417618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 835/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:53.417819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca68bb-fd8c-4f55-9df5-55ba6adec04a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.440233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.440848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.441127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.441396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.442079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.443825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.471921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 828/1663] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:53.477167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.495910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4233f-ed16-465a-8e67-394e1a16e1eb service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.503723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.505035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.505640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.507108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.508319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.510595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99f660-144d-43ff-8f08-c5f638149d1d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.533151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 836/1664] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:53.538665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.552528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a44ee-c943-480a-b160-f3b500eee271 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.569279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.570215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.570501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.570777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] PATH_INFO: `/v3/projects/232ccf533a8b48e2b956c5cec86d1f7c/users/3cc815eeb0ce433889844c0dae26a968/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.599427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] RBAC: Authorizing `identity:create_grant(project_id=232ccf533a8b48e2b956c5cec86d1f7c, user_id=3cc815eeb0ce433889844c0dae26a968, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.602621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.627035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 829/1665] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:53 2022] PUT /identity/v3/projects/232ccf533a8b48e2b956c5cec86d1f7c/users/3cc815eeb0ce433889844c0dae26a968/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:53.644046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.644339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.644620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.666290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.668991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:53.726712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] MFA Rules not processed for user `3cc815eeb0ce433889844c0dae26a968`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:53.727959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:53.883026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34c294-6938-4719-9bd6-bbf50dfd201a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:53.897187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:53.898084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:53.898366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:53.898641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] PATH_INFO: `/v3/projects/76f7d40334c84dbdb930548a3d0e0238` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:53.903328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f7d40334c84dbdb930548a3d0e0238)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:53.905280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:53.965537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 837/1666] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:53.969500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:53.995853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d606a2-53ce-42b6-956c-860f7c1bc5c3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.007896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.008655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.009434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.009434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.009873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.012038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.024579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:54.030672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f7d40334c84dbdb930548a3d0e0238', 'request_id': 'req-630bee0a-3d6d-4cd2-92ed-378390443080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:54.047990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f7d40334c84dbdb930548a3d0e0238', 'request_id': 'req-630bee0a-3d6d-4cd2-92ed-378390443080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:54.070069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f7d40334c84dbdb930548a3d0e0238', 'request_id': 'req-630bee0a-3d6d-4cd2-92ed-378390443080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:54.081765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 838/1667] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:53 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:59:54.086616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.130427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] The token cache is being invalidate because project 76f7d40334c84dbdb930548a3d0e0238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:59:54.132901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:54.134606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-630bee0a-3d6d-4cd2-92ed-378390443080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:54.139005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 830/1668] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:59:53 2022] DELETE /identity/v3/projects/76f7d40334c84dbdb930548a3d0e0238 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:59:54.148696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4e05-e554-40ff-aa5b-a811f78c6060 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.150116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4e05-e554-40ff-aa5b-a811f78c6060 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.151532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4e05-e554-40ff-aa5b-a811f78c6060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.194731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9a0b4e05-e554-40ff-aa5b-a811f78c6060 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:54.196320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9a0b4e05-e554-40ff-aa5b-a811f78c6060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:54.239874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b833-2e94-417a-ad80-a7da6679ead2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.245969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.247028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.247028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.247223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.248251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.250237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.275365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:54.306383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 831/1669] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:54.321012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 839/1670] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:54 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:59:54.323288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.323288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.323288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.329652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.329652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:54.373896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719a87-03e5-4955-b006-bd37d7ab91d9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.401766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.402479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.402760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.403077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.403733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.406006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.409198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:54.410427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:54.431556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 840/1671] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:54.443221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.446166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 832/1672] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:54.450749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.487793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb9137-079f-4003-ab1c-e5f58c06ea51 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.493174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.493838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.494258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.494565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.495192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:54.495494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.497231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.500934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f9500-e1b4-4517-91bc-d29ba82f2be8 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.510958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.512155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.513148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.513703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] PATH_INFO: `/v3/projects/012c1621e6a94192812c20e51d6af25a/users/5926d315a7a048d58a5b0fa004de88e4/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.531043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 833/1673] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:54.536221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.558656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451311c-137a-44a1-991b-1fbab48f41f9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.573925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.574472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.574754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.575031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.580662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.583152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.587164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c1621e6a94192812c20e51d6af25a, user_id=5926d315a7a048d58a5b0fa004de88e4, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.591183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.630467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 841/1674] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:54 2022] PUT /identity/v3/projects/012c1621e6a94192812c20e51d6af25a/users/5926d315a7a048d58a5b0fa004de88e4/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:54.638379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.660467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 834/1675] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:59:54.669785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.781533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfef-c471-4515-9605-2a5c75309087 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.811150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd5a5-e430-4b99-aa3b-29f17914fa9f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:54.825198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:54.827295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:54.827615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:54.827874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:54.828530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:54.832839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:54.927548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 835/1676] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:54 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:54.930070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:54.942871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:54.961916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:54.994847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610736-8985-47a1-873d-b7c89b91a2b7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:55.015185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.015890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.016126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.016412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.018146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.020925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.021884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.022403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.023268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] PATH_INFO: `/v3/projects/97ebdb8d60f64982b36bb2f28b222b2f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.025202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.026207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ebdb8d60f64982b36bb2f28b222b2f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.037625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.089400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 842/1677] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:55.092503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:55.169072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940632f-45d6-4458-aa31-f6c57e97ed43 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:55.199151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.199916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.200244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.200808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.201325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.210068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.252936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 843/1678] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:55.256521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:55.271648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ebdb8d60f64982b36bb2f28b222b2f', 'request_id': 'req-bdc4f7ae-7302-4484-ae70-596e6f261a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:55.283685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b1c4-55ba-44aa-a7e9-5792381d283e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:55.301150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ebdb8d60f64982b36bb2f28b222b2f', 'request_id': 'req-bdc4f7ae-7302-4484-ae70-596e6f261a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:55.333230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ebdb8d60f64982b36bb2f28b222b2f', 'request_id': 'req-bdc4f7ae-7302-4484-ae70-596e6f261a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:55.370106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] The token cache is being invalidate because project 97ebdb8d60f64982b36bb2f28b222b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:59:55.370398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:55.372864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:59:55.379838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 836/1679] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 12:59:54 2022] DELETE /identity/v3/projects/97ebdb8d60f64982b36bb2f28b222b2f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:55.391055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:55.400145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:55.465592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:55.505117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.506728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.507091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.507548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] PATH_INFO: `/v3/projects/012c1621e6a94192812c20e51d6af25a/users/5926d315a7a048d58a5b0fa004de88e4/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.525729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c1621e6a94192812c20e51d6af25a, user_id=5926d315a7a048d58a5b0fa004de88e4, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.529955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127fb2-28fe-4bda-ba1c-6c11c86eb56d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.552385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 844/1680] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:55 2022] PUT /identity/v3/projects/012c1621e6a94192812c20e51d6af25a/users/5926d315a7a048d58a5b0fa004de88e4/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:55.554525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.555243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.555530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.587579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4f7ae-7302-4484-ae70-596e6f261a6f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:55.610135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:55.614048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:55.754869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.755504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.755788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.756064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.756762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.758467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e13be9-d83f-4cf2-ae2e-d93739bf9f4f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.785200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 837/1681] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:55.787557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec532d2-e5fc-4b86-bf3d-7dbb0229c54a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.787854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec532d2-e5fc-4b86-bf3d-7dbb0229c54a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.788132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec532d2-e5fc-4b86-bf3d-7dbb0229c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.806463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 845/1682] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:55.807610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:55.842433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001b10-caf7-4f28-ba06-380c171d16cc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:55.857876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:55.859452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.860016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.860528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] PATH_INFO: `/v3/projects/2e573d531ac74d808b4a8a9be994e160/users/77e9ae5852b14878b3f9ef1c91f4ccf2/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:55.872858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cec532d2-e5fc-4b86-bf3d-7dbb0229c54a None None] MFA Rules not processed for user `5926d315a7a048d58a5b0fa004de88e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:55.874297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cec532d2-e5fc-4b86-bf3d-7dbb0229c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:55.900528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e573d531ac74d808b4a8a9be994e160, user_id=77e9ae5852b14878b3f9ef1c91f4ccf2, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:55.905330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d082d18-6142-4f87-b03d-e9dc1f5aecc2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:55.956392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 846/1683] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:55 2022] PUT /identity/v3/projects/2e573d531ac74d808b4a8a9be994e160/users/77e9ae5852b14878b3f9ef1c91f4ccf2/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:55.957610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:55.957898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:55.958172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.006348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:56.007941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:56.080802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 838/1684] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:56.086346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.086346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.086346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.140167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:56.159893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] MFA Rules not processed for user `77e9ae5852b14878b3f9ef1c91f4ccf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:56.163662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:56.205935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 847/1685] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:56.205935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.205935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:56.255582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:56.325421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 839/1686] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:56.339891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.366187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a49e8-2041-46af-be39-ad829b367f75 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.366412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79504de-129d-4828-9a7c-8a261fe0c505 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.375904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:56.376804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.377226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.377561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.381597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:56.382555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.382848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.383182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.385088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:59:56.385675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:56.389661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:56.422134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 840/1687] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 12:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:59:56.423968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.447622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf49ca0-75ae-418f-a697-6937cae01dbb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.462286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:56.463074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.463362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.465039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.465914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:56.473235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:56.529337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:56.531240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:56.558236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 841/1688] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:56 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:56.559999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 848/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:56.561248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.571834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.606720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4936-cb39-4ce5-ab03-0cfc621f7003 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.775255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a237-e58c-49fc-9101-bef4f5842eb3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.787990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:56.789119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.790725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.791527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.802308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:56.804959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:56.840196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:56.840628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:56.840909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:56.841284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:56.842253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:56.844084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:56.848525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 842/1690] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 12:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:56.848525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.853450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:56.915395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 849/1691] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:56 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:56.921687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:56.952150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d5b08-ea9c-4b62-b447-0a2e3863b55f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:56.996842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a386d-a817-4e94-906a-22943dca24b6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.018385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.019280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.019452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.019592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.022217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:57.034522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:57.138992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.142953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.143714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.144783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.146251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.153385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.173691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:57.222386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 850/1692] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 12:59:56 2022] POST /identity/v3/users => generated 287 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:59:57.229594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.234244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.235273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.256441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01e7f7-7138-4980-ac95-1950c00a9300 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.277442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 843/1693] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:57.279473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.287298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.290516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.292496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.296742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.298130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.303461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.324402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6dab-a01a-484f-800b-e28ea2843274 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.349813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.353657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 851/1694] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:57.354641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.355374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.355697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.355978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.356687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.362875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.397383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 844/1695] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:57.401156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b0db-8cb8-431a-8389-a9387b3cb7da admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.407930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.415372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.416066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.416349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.416630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] PATH_INFO: `/v3/projects/d14a4be427884eeaabda84ee409a3883/users/0c8d59d50e8949caa167140ce1db17b9/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.453428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0235-f9b0-4947-be61-9067bf5ad72f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.469312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.472412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.472702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.472985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.474889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14a4be427884eeaabda84ee409a3883, user_id=0c8d59d50e8949caa167140ce1db17b9, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.476025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.477287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.484935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.525050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 845/1696] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:57.526165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.532100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 852/1697] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:57 2022] PUT /identity/v3/projects/d14a4be427884eeaabda84ee409a3883/users/0c8d59d50e8949caa167140ce1db17b9/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:57.537277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.546221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b5b1-6fb8-4cd5-98d4-65de061d2fca admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.672157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.674685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.677263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.678034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] PATH_INFO: `/v3/projects/473826c71c814f13b14bd9f5859f2730/users/a5e60403f9174fd59df75dd72dc25611/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.692581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419f96-54a3-4f68-9797-c692746023d4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.705697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:57.708880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.711266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.711785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.713516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.718896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.725035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=473826c71c814f13b14bd9f5859f2730, user_id=a5e60403f9174fd59df75dd72dc25611, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:57.737878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a266d7-6d97-496b-9236-2e6837940c1d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:57.748211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 853/1698] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:59:57.755713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:57.780169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 846/1699] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:57 2022] PUT /identity/v3/projects/473826c71c814f13b14bd9f5859f2730/users/a5e60403f9174fd59df75dd72dc25611/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:57.800737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:57.801003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:57.803674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:57.818682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e95f-201c-492b-89d5-e06e7a57e429 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:57.944370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] MFA Rules not processed for user `a5e60403f9174fd59df75dd72dc25611`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:57.946669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:57.995593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:58.000052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:58.000457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:58.000799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] PATH_INFO: `/v3/projects/d14a4be427884eeaabda84ee409a3883/users/0c8d59d50e8949caa167140ce1db17b9/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:58.007686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14a4be427884eeaabda84ee409a3883, user_id=0c8d59d50e8949caa167140ce1db17b9, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:58.015978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9de08-6284-4a3c-8094-8d91e79fba5b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:58.044417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 854/1700] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 12:59:57 2022] PUT /identity/v3/projects/d14a4be427884eeaabda84ee409a3883/users/0c8d59d50e8949caa167140ce1db17b9/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:59:58.055846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:58.056622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:58.056622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:58.085300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:58.131621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] MFA Rules not processed for user `0c8d59d50e8949caa167140ce1db17b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:59:58.135109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:58.155213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 847/1701] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:59:58.169095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:58.178939 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:59:58.315944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:58.333983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 855/1702] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:59:58.357805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:59:58.421520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd672-9809-499f-a53e-5cf60b776fd1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:58.491184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901879f6-7ae0-49ee-95ba-b0bb7c15c3de None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:59:58.500411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:58.501645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:58.501645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:58.501862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:58.592961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:59:58.593669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:59:58.593952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:59:58.594231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:59:58.651540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:58.654247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb023c97-1edd-4bb0-869d-8257c4c957cb service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:58.679229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 856/1703] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:59:58.788819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:59:58.794208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d845b-f30d-42ce-a0b9-23abb58cce81 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:59:58.823671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 848/1704] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:01.093729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:01.094969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:01.095913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:01.188040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] MFA Rules not processed for user `e8a9079515ec45e2b8ed94e848ffcf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:01.190870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:01.303990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:01.391829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 857/1705] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:01.402720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef880d-ab14-4cbe-a176-7cc137fec653 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:01.403396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef880d-ab14-4cbe-a176-7cc137fec653 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:01.403396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef880d-ab14-4cbe-a176-7cc137fec653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:01.445815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a0ef880d-ab14-4cbe-a176-7cc137fec653 None None] MFA Rules not processed for user `e8a9079515ec45e2b8ed94e848ffcf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:01.447065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a0ef880d-ab14-4cbe-a176-7cc137fec653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:01.462752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 849/1706] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:01.474479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:01.494853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846dd14-f6b7-4482-bf25-8445c5c2d6f1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:01.509734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:01.510724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:01.510724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:01.511514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:01.534598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:01.536220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:01.578449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 858/1707] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:02.200140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:02.200423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:02.200704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:02.323476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] MFA Rules not processed for user `b0dc5717680e45268974b5912e8c7308`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:02.324779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:02.535344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:02.600907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:02.603169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:02.608262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 850/1708] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:02.639250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e5ea-a95f-47e2-ab0f-1fe6c2a00bcf service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:02.657335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:02.666420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:02.666915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:02.667955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:02.706218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:02.707848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4b34-041d-4241-b31b-0629285f132b service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:02.726675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:02.743964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab99fa-80ef-4d4a-833a-53b91f922793 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:02.759354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 859/1709] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:02.778078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:02.778729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:02.779010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:02.779287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:02.822741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:02.822741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:02.823060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:02.836443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:02.840455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:02.887305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 851/1710] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:02.914764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] MFA Rules not processed for user `af3f4441d96c4343b655b13d60eed759`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:02.926438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:03.125534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 860/1711] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:03.143760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:03.176343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5a793-4325-4f2e-9460-8ffd58bcea78 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:03.193527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:03.194375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:03.194655 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:03.194935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:03.215869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:03.221086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144d86-7886-4754-941c-5da8ac540f7e service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:03.248953 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 852/1712] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:03.690117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:03.765972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bf87-5c43-4d60-8b79-27405d43b0b6 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:03.767368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bf87-5c43-4d60-8b79-27405d43b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:03.769140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bf87-5c43-4d60-8b79-27405d43b0b6 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:03.776453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 853/1713] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 13:00:03 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:00:03.783227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:03.785305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:03.786046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:03.896368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:03.898315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:03.914969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbbed6-dd8b-459a-a6d6-e255281a26a2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:03.921118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:03.922420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:03.925688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:03.926215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] PATH_INFO: `/v3/users/a5e60403f9174fd59df75dd72dc25611` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:03.930200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e60403f9174fd59df75dd72dc25611)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:03.932556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:04.037874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:04.052546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e60403f9174fd59df75dd72dc25611'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.062572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 854/1714] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:04.067601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e60403f9174fd59df75dd72dc25611'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.081248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:04.083085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:04.124550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e60403f9174fd59df75dd72dc25611'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.135287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfb2f2-c43f-4e7e-8cc9-c9a5744c91aa None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:04.143515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e60403f9174fd59df75dd72dc25611'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.145150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3b56c148-b3b7-4164-b2e3-af9597d4d962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e60403f9174fd59df75dd72dc25611'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.149742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:04.154975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.155270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.156082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] PATH_INFO: `/v3/users/3cc815eeb0ce433889844c0dae26a968` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.161993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc815eeb0ce433889844c0dae26a968)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:04.168282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 861/1715] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:03 2022] DELETE /identity/v3/users/a5e60403f9174fd59df75dd72dc25611 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:04.169866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:04.176466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.176918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.178038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.232720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:04.234047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:04.307572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc815eeb0ce433889844c0dae26a968'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.351545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc815eeb0ce433889844c0dae26a968'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.356331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc815eeb0ce433889844c0dae26a968'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.385768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 862/1716] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:04.387129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:04.388544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:04.437036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc815eeb0ce433889844c0dae26a968'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.459273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-41130fe1-a5d1-49c5-b571-6dc4cfe6817f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc815eeb0ce433889844c0dae26a968'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:04.474209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 855/1717] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:04 2022] DELETE /identity/v3/users/3cc815eeb0ce433889844c0dae26a968 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:04.480194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5af0-c82d-429a-a2de-bce520275019 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.480800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5af0-c82d-429a-a2de-bce520275019 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.481941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5af0-c82d-429a-a2de-bce520275019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.555155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5ebc5af0-c82d-429a-a2de-bce520275019 None None] MFA Rules not processed for user `d2292379507f425aa217920f15aba22d`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:04.555250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051311a3-cb1c-495c-967e-22763eaf89bd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:04.558519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ebc5af0-c82d-429a-a2de-bce520275019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:04.669385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:04.699768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:04.699768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.699768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.699768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.703751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:04.755389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:04.756863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:04.788753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 863/1718] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:04.789950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:04.818298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175436b-15a6-40e6-882d-438cc66290b3 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:04.833646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 856/1719] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:04.846971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.847484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.847759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.848948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:04.849632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:04.849891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:04.850193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:04.910212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:04.911995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:04.918440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:05.025681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 857/1720] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:05.025681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:05.030461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:05.123060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:05.123665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:05.164805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 864/1721] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:05.165543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:05.173398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:05.216741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb4c7-abaf-4adf-a8fe-6970e14a7265 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:05.235546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:05.236561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:05.236680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:05.239708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:05.265705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:05.267839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:05.270679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2d21-cf6e-4511-96f1-ae794e1d3024 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:05.277658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:05.278747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:05.279827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:05.280121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:05.308463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 865/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:05.313249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:05.316187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d079c4-74f1-4c6b-ad54-1cf07b2ef5eb service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:05.339157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 858/1723] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:06.531480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:06.535396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:06.728595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3caf-f539-429b-be90-6212aefb0f25 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:06.745514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:06.746183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:06.746702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:06.746826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:06.764254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:06.806919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:06.807889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:06.808326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:06.843481 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:06.845151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d61e36-d3af-47fa-91ee-4aec9347e337 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:06.882754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 866/1724] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:06.920815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:06.921113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:06.921389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:06.948275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] MFA Rules not processed for user `20d7ffc4385842b6bd380b65c7ca1507`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:06.948275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.045070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] MFA Rules not processed for user `e8a9079515ec45e2b8ed94e848ffcf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:07.046465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.140447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:07.226827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 859/1725] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:07.227806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:07.241779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.302672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 867/1726] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:07.303706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:07.306778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.329216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a357c-1edf-45b0-be67-f6d5b00aa44d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:07.346105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:07.347449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.347837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.350246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] PATH_INFO: `/v3/projects/232ccf533a8b48e2b956c5cec86d1f7c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.354719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] RBAC: Authorizing `identity:delete_project(project_id=232ccf533a8b48e2b956c5cec86d1f7c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:07.359773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:07.392702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a571-b054-4c67-ad4b-eab71c69ba75 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:07.412857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:07.414124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.414502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.415000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] PATH_INFO: `/v3/projects/473826c71c814f13b14bd9f5859f2730` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.426861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473826c71c814f13b14bd9f5859f2730)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:07.429603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:07.471681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232ccf533a8b48e2b956c5cec86d1f7c', 'request_id': 'req-ae15e17e-89a9-433c-9f0d-71af6178925b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.479014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232ccf533a8b48e2b956c5cec86d1f7c', 'request_id': 'req-ae15e17e-89a9-433c-9f0d-71af6178925b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.488139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232ccf533a8b48e2b956c5cec86d1f7c', 'request_id': 'req-ae15e17e-89a9-433c-9f0d-71af6178925b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.513710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] The token cache is being invalidate because project 232ccf533a8b48e2b956c5cec86d1f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:07.516869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.516869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ae15e17e-89a9-433c-9f0d-71af6178925b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.519001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 860/1727] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:07 2022] DELETE /identity/v3/projects/232ccf533a8b48e2b956c5cec86d1f7c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:07.521106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba48035-db92-407a-ba93-fdeceb2daa38 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.521409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba48035-db92-407a-ba93-fdeceb2daa38 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.521790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba48035-db92-407a-ba93-fdeceb2daa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.540161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:07.585039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473826c71c814f13b14bd9f5859f2730', 'request_id': 'req-82d98fac-9da5-4f12-a239-78f7fc4d7a66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.588708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0ba48035-db92-407a-ba93-fdeceb2daa38 None None] MFA Rules not processed for user `20d7ffc4385842b6bd380b65c7ca1507`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:07.592495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0ba48035-db92-407a-ba93-fdeceb2daa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.614453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473826c71c814f13b14bd9f5859f2730', 'request_id': 'req-82d98fac-9da5-4f12-a239-78f7fc4d7a66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.623697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473826c71c814f13b14bd9f5859f2730', 'request_id': 'req-82d98fac-9da5-4f12-a239-78f7fc4d7a66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.646919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] The token cache is being invalidate because project 473826c71c814f13b14bd9f5859f2730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:07.648464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.649749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.653773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 868/1728] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:07 2022] DELETE /identity/v3/projects/473826c71c814f13b14bd9f5859f2730 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:07.656644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:07.660686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.718118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 861/1729] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:07.730242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af5fa-fb2a-49fc-9b65-07f0e284b386 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.730242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af5fa-fb2a-49fc-9b65-07f0e284b386 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.730242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af5fa-fb2a-49fc-9b65-07f0e284b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.763032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b60af5fa-fb2a-49fc-9b65-07f0e284b386 None None] MFA Rules not processed for user `af3f4441d96c4343b655b13d60eed759`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:07.764406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b60af5fa-fb2a-49fc-9b65-07f0e284b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.786325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98fac-9da5-4f12-a239-78f7fc4d7a66 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:07.809978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:07.811574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.811957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.812367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] PATH_INFO: `/v3/users/5926d315a7a048d58a5b0fa004de88e4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.814250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5926d315a7a048d58a5b0fa004de88e4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:07.816541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:07.854434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 862/1730] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:07.855825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:07.856277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:07.856582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:07.916627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:07.918172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.929686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 863/1731] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:07.930622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:07.932004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:07.938900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:07.941654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5926d315a7a048d58a5b0fa004de88e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:07.971663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5926d315a7a048d58a5b0fa004de88e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:08.006202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5926d315a7a048d58a5b0fa004de88e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:08.026505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5926d315a7a048d58a5b0fa004de88e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:08.033471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ba04648-df47-4909-836f-1187cd18cf68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5926d315a7a048d58a5b0fa004de88e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:08.053152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 869/1732] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:07 2022] DELETE /identity/v3/users/5926d315a7a048d58a5b0fa004de88e4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:08.057188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.057552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.057810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.102885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:08.111613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccdfb0-709f-4916-9a2c-f84ff5c83d64 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:08.113162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:08.226449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:08.304613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 870/1733] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:08.308784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:08.319957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:08.320606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.320887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.321164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.323540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:08.333796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d86c-b31b-4af2-bf9a-6d4a7b12f5fe None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:08.364545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:08.366566 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.370448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.370937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.371805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:08.372931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:08.383212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:08.445469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 871/1734] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:08.447625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:08.488329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474ce5-9f85-497f-9185-c88944db697d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:08.508080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:08.509063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.511893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.512869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.514338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:08.519576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:08.540089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:08.546097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:08.575234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 864/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:08.640853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 872/1736] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:08 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:08.643115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:08.664629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146d54-22a5-40b6-8ff3-5bc0e60f8310 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:08.789620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:08.842717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:08.843392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.843812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.844102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.846954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:08.863372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:08.923821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:08.926862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:08.952651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0fda-4f67-41ce-b381-6113621979e7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:08.970556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 865/1737] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:08 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:08.971010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:08.974330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:08.975042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:08.976593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:08.976924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] PATH_INFO: `/v3/projects/012c1621e6a94192812c20e51d6af25a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:08.981351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] RBAC: Authorizing `identity:delete_project(project_id=012c1621e6a94192812c20e51d6af25a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:08.988941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:09.019910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc252-66f9-4814-9ea9-5e08ac9b7575 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:09.037970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:09.038866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.039146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.039415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.040124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:09.047038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:09.077519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 866/1738] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:09.106660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:09.134852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95e09a-ad32-48b6-aa81-24a0b7838f52 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:09.162213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012c1621e6a94192812c20e51d6af25a', 'request_id': 'req-4f644e5e-79ed-4538-a7b1-3521a434674d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:09.179165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012c1621e6a94192812c20e51d6af25a', 'request_id': 'req-4f644e5e-79ed-4538-a7b1-3521a434674d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:09.202096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012c1621e6a94192812c20e51d6af25a', 'request_id': 'req-4f644e5e-79ed-4538-a7b1-3521a434674d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:09.287529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] The token cache is being invalidate because project 012c1621e6a94192812c20e51d6af25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:09.288001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:09.290450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-4f644e5e-79ed-4538-a7b1-3521a434674d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:09.301908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 873/1739] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:08 2022] DELETE /identity/v3/projects/012c1621e6a94192812c20e51d6af25a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:09.302915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:09.303689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.304079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.304560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.305415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:09.307213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:09.311251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd326b4-1725-453d-9ed1-1ec4d8ff7ccc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.311722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd326b4-1725-453d-9ed1-1ec4d8ff7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.312200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd326b4-1725-453d-9ed1-1ec4d8ff7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.347224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 867/1740] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:09.351495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:09.353801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:09.397096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fc504-1a18-4c55-8fdd-cdb994eb6b64 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:09.401447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8cd326b4-1725-453d-9ed1-1ec4d8ff7ccc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:09.403938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8cd326b4-1725-453d-9ed1-1ec4d8ff7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:09.420258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:09.421603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.423234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.424228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] PATH_INFO: `/v3/projects/287085a2977447b480850d38f688d1a5/users/c935acbf2a7d478c898082eac44b7332/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.472729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287085a2977447b480850d38f688d1a5, user_id=c935acbf2a7d478c898082eac44b7332, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:09.478335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 874/1741] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:09.483266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a11ff-91e9-44b0-85ab-0f17d247c4d1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:09.488812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.504340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.505385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.517412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 868/1742] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:09 2022] PUT /identity/v3/projects/287085a2977447b480850d38f688d1a5/users/c935acbf2a7d478c898082eac44b7332/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:09.528665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.528965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.529216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.586259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] MFA Rules not processed for user `c935acbf2a7d478c898082eac44b7332`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:09.587838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:09.588681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:09.594489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:09.809764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 869/1743] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:09.811001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:09.879056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 875/1744] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:09.880063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:09.894925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:09.911403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234c80-c490-46fa-bdfd-5d6ca0fcd119 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:09.927849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:09.927849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:09.928162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:09.928367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:09.929058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:09.931174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:09.932877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:09.990176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 876/1745] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:09.991271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.016234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:10.026717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688048-fd6d-493d-aaeb-ffd0e87d19f5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.058330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.059070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.060064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcbe15-cc38-49fa-979b-8fde59cc4718 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.061726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.062958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.064385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.076562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87cd09-0f60-4a1c-a34d-3c42649872ed admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.082547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.083482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.083610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.083894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.088552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.090586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.171951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 877/1746] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:09 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:10.179137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ccd0-e89d-436d-a4c7-523106f8e306 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.180883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ccd0-e89d-436d-a4c7-523106f8e306 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.181666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ccd0-e89d-436d-a4c7-523106f8e306 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.190400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 870/1747] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:09 2022] POST /identity/v3/projects => generated 387 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:10.191776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 878/1748] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 13:00:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:00:10.192664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ccd0-e89d-436d-a4c7-523106f8e306 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.192842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.467929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58de5-3992-4db3-86c4-b3572ee167e2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.475378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.476254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.476812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.477435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.478278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.481513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621128-4559-4bbd-8ac5-907ad799bd34 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.486333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ccd0-e89d-436d-a4c7-523106f8e306 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.495710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.497084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.497731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.498386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.499424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.503599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8bee5-ac64-43f0-bdae-2d3826a16df3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.517342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 871/1749] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:10 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:10.519938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.520868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.521781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.551434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 879/1750] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:10 2022] POST /identity/v3/users => generated 294 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:10.556081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:10.556268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.556571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.556679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.557777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:10.605208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] MFA Rules not processed for user `b0dc5717680e45268974b5912e8c7308`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:10.614595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:10.640967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 872/1751] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:10.642601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.656803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e483-a5bf-4797-b23b-e4c4308f380d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.665679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.666791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.667298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.667722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.677865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.681474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.699694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 873/1752] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:10.700549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.718102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1610b-e4b4-4387-aa63-c11497b17f5e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.737361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.740283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.740576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.740855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.742614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.745258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.763935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 874/1753] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:10.765943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.768809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:10.785604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa344a-2921-4c5a-8aab-d0d02f2c57f0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.789589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.790183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.790580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.790844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.802236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.818654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.841424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 880/1754] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:10.863412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.873258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 875/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:10.879905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.906881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac861f91-77bf-40d4-97dc-991741398e94 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.919788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70e4e-1762-4f4f-be38-5cddde89a0d9 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:10.923831 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.925054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.926886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.927414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.928765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.934550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.935407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:10.937454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:10.937880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:10.938265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:10.939998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:10.944133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:10.957666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:10.985004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 881/1756] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:10.986958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:10.998054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 876/1757] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:10.999265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:11.030864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e2df-4dc0-476c-ba8f-29b1326a8f32 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:11.038870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba2db-d89a-4f67-9bc2-6adb2bae64aa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:11.046895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:11.051674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:11.052002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.052336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.053561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] PATH_INFO: `/v3/projects/58bc9f670cf044a59f132927eb512d1f/users/184155348d34418392e370c4b743c5d8/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.055159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.055562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.055908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] PATH_INFO: `/v3/projects/63d54d756bee426ea9e1be740a24308a/users/8c746aacd8e74568ae7019475dfc1043/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.103389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bc9f670cf044a59f132927eb512d1f, user_id=184155348d34418392e370c4b743c5d8, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:11.106551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d54d756bee426ea9e1be740a24308a, user_id=8c746aacd8e74568ae7019475dfc1043, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:11.111001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b534d2a-1da4-4c89-9ef4-6eb9d7702687 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:11.114052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556dcf-7efd-4b1d-abf4-5b3695ccfb5f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:11.185457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 877/1758] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:10 2022] PUT /identity/v3/projects/63d54d756bee426ea9e1be740a24308a/users/8c746aacd8e74568ae7019475dfc1043/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:11.186764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 882/1759] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:10 2022] PUT /identity/v3/projects/58bc9f670cf044a59f132927eb512d1f/users/184155348d34418392e370c4b743c5d8/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:11.201227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8612-0dff-4b29-8f77-ce8e041363c6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.201475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.201735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.202136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.209094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8612-0dff-4b29-8f77-ce8e041363c6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.211217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8612-0dff-4b29-8f77-ce8e041363c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.280738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] MFA Rules not processed for user `184155348d34418392e370c4b743c5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:11.293781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:11.306983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ba1c8612-0dff-4b29-8f77-ce8e041363c6 None None] MFA Rules not processed for user `8c746aacd8e74568ae7019475dfc1043`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:11.308440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ba1c8612-0dff-4b29-8f77-ce8e041363c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:11.395769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:11.511734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 883/1760] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:11.512010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:11.585698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 878/1761] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:11.597755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.598819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.601520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.708999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5183a-e1e4-4c3e-b8c1-37b93211a0e8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:11.731349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:11.731349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:11.731644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:11.731829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:11.732477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:11.738665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:11.859349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 884/1762] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:11 2022] POST /identity/v3/projects => generated 379 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:11.861905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:11.919335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:11.935938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:12.070646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99dc21-3d17-4097-abd1-624d33e9dc19 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.088456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.089672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.090458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.091043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.094114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.100692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fa94-3e30-44fd-bffe-0e13b047d96d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.163424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 879/1763] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:12.164538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.186752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b6b5-07db-420d-8ce7-795261d9a591 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.203241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.213379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.214281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 885/1764] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:11 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:12.215375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.215666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.218320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.218615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.218911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.219262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.225245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.275062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] MFA Rules not processed for user `d2292379507f425aa217920f15aba22d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:12.276627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:12.283675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 880/1765] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:12 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:12.284706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.302742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f5948-aea6-4c5a-9c0f-b7329d7a1531 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.339874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:12.447554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:12.454573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.456256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.456256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.456256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.458204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.461908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.530214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 886/1766] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:12.530214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.534279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 881/1767] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:12 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:12.539461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.540850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:12.565658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64362a-4820-44cd-a6da-f34a76af5e77 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.591384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.592268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.593194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.596112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.597024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.603005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.640062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 887/1768] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:12.641386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.671011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ca6f-7198-43f7-b736-0b9d733f051e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.681936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.683149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.683670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.703295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.707922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.718048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.778581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 888/1769] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:12.782968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.792975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf4fa4-84cb-41df-8a82-5eefdc2c7ce9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.801805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.802598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.803044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.803341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.839369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d75718-de7d-4e91-a33d-90aa7921cab8 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.856343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.859592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.861164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.862088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:12.866380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:12.876871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:12.920734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 889/1770] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:12.923837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:12.962486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fbf8-3204-4ec6-b96c-51e1c0ab59f4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:12.985085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:12.988307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:12.989152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:12.989777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] PATH_INFO: `/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43/users/763eedfd54a942429028c19d13f28e2c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.019341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.024542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.053801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b5e30b0a0e4fbe94214bea9c384b43, user_id=763eedfd54a942429028c19d13f28e2c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.056200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 882/1771] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:00:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:13.058924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:13.061356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.101410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef524-3f64-4462-b2d1-081e0a2a3479 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:13.109678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:13.119154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.119683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.120150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] PATH_INFO: `/v3/projects/6e8609dd93d14cc581470e687381140b/users/98f260e9d05241539523dd986ebaaf10/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.177464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8609dd93d14cc581470e687381140b, user_id=98f260e9d05241539523dd986ebaaf10, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.179838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 890/1772] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:12 2022] PUT /identity/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43/users/763eedfd54a942429028c19d13f28e2c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:13.180409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e79bc-ebb1-4921-800b-040f1b6e7a2f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.181625 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:13.230773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 883/1773] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:13 2022] PUT /identity/v3/projects/6e8609dd93d14cc581470e687381140b/users/98f260e9d05241539523dd986ebaaf10/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:13.244570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b182f-5600-4213-a4c3-022664bded33 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.245035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b182f-5600-4213-a4c3-022664bded33 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.245650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b182f-5600-4213-a4c3-022664bded33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.267886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:13.312967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-506b182f-5600-4213-a4c3-022664bded33 None None] MFA Rules not processed for user `98f260e9d05241539523dd986ebaaf10`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:13.313754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-506b182f-5600-4213-a4c3-022664bded33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:13.517191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b9f2f-0a31-4f37-8f99-01bc84f4422a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:13.596812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 884/1774] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:13.598206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b182f-5600-4213-a4c3-022664bded33 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:13.753191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:13.756579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.757459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.758109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.763767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.769580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.795310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 891/1775] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 614 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:13.800316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:13.824753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316425-cd6c-45d9-b0ef-690a66c7ee29 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:13.827920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b182f-5600-4213-a4c3-022664bded33 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:13.839395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:13.851156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.851805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:13.852289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.852751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] PATH_INFO: `/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43/users/763eedfd54a942429028c19d13f28e2c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.853582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.854756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.855491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.856736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.858220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b5e30b0a0e4fbe94214bea9c384b43, user_id=763eedfd54a942429028c19d13f28e2c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:13.862511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.865642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddc20-6d2b-4d29-a012-9c25145048d5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:13.899485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 892/1776] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:13 2022] PUT /identity/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43/users/763eedfd54a942429028c19d13f28e2c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:13.916849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:13.917197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:13.917402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:13.949319 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 885/1777] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:13 2022] POST /identity/v3/projects => generated 377 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:13.954717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.023361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] MFA Rules not processed for user `763eedfd54a942429028c19d13f28e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:14.024613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:14.066583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:14.189956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b544-9fc3-4fd1-b040-8ee26c833f62 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.200978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.202550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.203025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.204780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.207580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.210577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:14.245576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 893/1778] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:14.262402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.265144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:14.284418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 886/1779] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:13 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:14.291245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.346828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78170bc-7fd5-4bd9-96f9-5d46082b11a7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.359287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.361813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.362168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.362746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.363590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.366072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:14.370378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:14.386738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 887/1780] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:14.391683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.410305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7605-4ed6-41c7-847e-8093c5c2e1f5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.423557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.424324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.424837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.425247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] PATH_INFO: `/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239/users/6ee47f031e59408982471e56d0f76308/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.468773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a30cb1b8b4ed0aabc804afa6e4239, user_id=6ee47f031e59408982471e56d0f76308, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.479866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:14.498105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a802-84fa-43f1-9865-dc033e631552 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.508546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 888/1781] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:14 2022] PUT /identity/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239/users/6ee47f031e59408982471e56d0f76308/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:14.514545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.733155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f191-8d15-4eee-8f1b-a43dfec5be1f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.739875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.741019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.741596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.741915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.742726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.745356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:14.768949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 889/1782] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:14.774362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:14.775741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.781703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.782768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.790526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.831524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a491676-e742-4671-98e7-ba879ed32194 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:14.843434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:14.846030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.846735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.854178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] PATH_INFO: `/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239/users/6ee47f031e59408982471e56d0f76308/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.864126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a30cb1b8b4ed0aabc804afa6e4239, user_id=6ee47f031e59408982471e56d0f76308, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.870577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e7cc-d569-433b-b733-c72f107a08e5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:14.905556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 890/1783] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:14 2022] PUT /identity/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239/users/6ee47f031e59408982471e56d0f76308/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:14.919206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:14.919502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:14.919785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:14.988263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:14.998399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:15.015798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 894/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:15.018129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] MFA Rules not processed for user `6ee47f031e59408982471e56d0f76308`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:15.019775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:15.242929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 891/1785] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:15.261078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:15.263423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:15.277764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd7b2-444d-477a-adaf-94565346f9f7 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:15.292700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:15.411715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:15.412298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:15.412722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:15.413352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:15.437547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:15.439801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1508a5-8d17-4f91-9818-4a771ea9bc25 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:15.484428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 895/1786] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:15.789288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:15.804043 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a31f1c-ff39-461a-a981-c4f6d2fef7c7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:15.822623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:15.823668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:15.823904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:15.824278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:15.926532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:16.012398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:16.012613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:16.040341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 892/1787] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:17.264011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:17.264605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:17.269329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:17.340590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:17.342116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:17.611855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 896/1788] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Aug 31 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:17.904292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:17.923397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b80e8-93c4-48b0-9585-db3475110364 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:17.947390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:17.961575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:17.962106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:17.962465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:18.043039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:18.050086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2d202-2d92-4641-86a2-aff8e0e5ea44 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:18.124366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 893/1789] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:18.250055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:18.275053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83754b4-ca71-4b19-893e-26006a3f9aa3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:18.299176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:18.300225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:18.305754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:18.306184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:18.610706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:18.619449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f86a9-de53-46e3-87f2-e6e4fb1e9297 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:18.671194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 897/1790] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:20.349886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:20.350775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:20.350775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:20.353076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 894/1791] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:00:20.359928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644181b-78b1-4510-bb92-bf943cdd951d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:20.361154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644181b-78b1-4510-bb92-bf943cdd951d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:20.361254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644181b-78b1-4510-bb92-bf943cdd951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:20.394922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9644181b-78b1-4510-bb92-bf943cdd951d None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:20.397153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9644181b-78b1-4510-bb92-bf943cdd951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:20.723077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:20.774653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:20.776765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:20.796331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 898/1792] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:21.230404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f302-b060-49cb-87a5-62b59888a173 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:21.281472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:21.282646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:21.283115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:21.283581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] PATH_INFO: `/v3/users/77e9ae5852b14878b3f9ef1c91f4ccf2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:21.298812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e9ae5852b14878b3f9ef1c91f4ccf2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:21.316895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:21.453432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e9ae5852b14878b3f9ef1c91f4ccf2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.476353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e9ae5852b14878b3f9ef1c91f4ccf2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.477146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e9ae5852b14878b3f9ef1c91f4ccf2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.504799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e9ae5852b14878b3f9ef1c91f4ccf2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.527728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e9ae5852b14878b3f9ef1c91f4ccf2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.545564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 895/1793] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:20 2022] DELETE /identity/v3/users/77e9ae5852b14878b3f9ef1c91f4ccf2 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:21.551153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:21.552278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:21.553585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:21.612735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:21.614513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:21.708902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 899/1794] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:21.712793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:21.714444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:21.747976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7997-fa01-4320-988b-956b84498061 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:21.757067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:21.757941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:21.758386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:21.758762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] PATH_INFO: `/v3/users/184155348d34418392e370c4b743c5d8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:21.760382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184155348d34418392e370c4b743c5d8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:21.763711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:21.869864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:21.887744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184155348d34418392e370c4b743c5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.927545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184155348d34418392e370c4b743c5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.928429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184155348d34418392e370c4b743c5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.958705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:21.960019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184155348d34418392e370c4b743c5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.961004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:21.977853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8fd3ff1f-d25d-4f98-b967-3c5402fb6ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184155348d34418392e370c4b743c5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:21.994430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 896/1795] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:21 2022] DELETE /identity/v3/users/184155348d34418392e370c4b743c5d8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:21.996009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:21.996307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:21.996724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:22.047533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:22.051004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:22.167129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556b27-cc6e-4660-9b68-591cb3fedac3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:22.254128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 897/1796] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:22.298088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:22.299846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:22.375210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:22.376197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:22.376890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:22.376890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:22.379776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:22.397169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:22.398777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:22.414450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 900/1797] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:22.473914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3820da-7370-4a99-a82c-e529068988c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:22.493464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:22.494461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:22.494902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:22.495326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:22.573311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:22.590216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:22.670833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 898/1798] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:23.208194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:23.209947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:23.431428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:23.476935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:23.479745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:23.506203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec847-85fc-4f0c-83de-34ffdc62135a service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:23.518034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:23.519016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:23.519687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ac-266a-45ed-ae98-3a33fc5ed487 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:23.519933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:23.520408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:23.540263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:23.548279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:23.549225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:23.554189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:23.554478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] PATH_INFO: `/v3/projects/58bc9f670cf044a59f132927eb512d1f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:23.566467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bc9f670cf044a59f132927eb512d1f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:23.580136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:23.587966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:23.596184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:23.652776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 901/1799] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:23.689671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bc9f670cf044a59f132927eb512d1f', 'request_id': 'req-555dd4da-eef8-431d-bd25-d727031014b6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:23.700555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bc9f670cf044a59f132927eb512d1f', 'request_id': 'req-555dd4da-eef8-431d-bd25-d727031014b6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:23.711584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:23.726431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bc9f670cf044a59f132927eb512d1f', 'request_id': 'req-555dd4da-eef8-431d-bd25-d727031014b6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:23.751480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] The token cache is being invalidate because project 58bc9f670cf044a59f132927eb512d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:23.756670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:23.757790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555dd4da-eef8-431d-bd25-d727031014b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:23.768878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 899/1800] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:23 2022] DELETE /identity/v3/projects/58bc9f670cf044a59f132927eb512d1f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:23.771450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:23.798390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921db7-647c-4d72-9aad-386582d88810 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:24.026931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:24.028913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:24.029319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:24.029747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] PATH_INFO: `/v3/users/98f260e9d05241539523dd986ebaaf10` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:24.034033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f260e9d05241539523dd986ebaaf10)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:24.038428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:24.176403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f260e9d05241539523dd986ebaaf10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:24.192796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f260e9d05241539523dd986ebaaf10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:24.249836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f260e9d05241539523dd986ebaaf10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:24.270518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f260e9d05241539523dd986ebaaf10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:24.274143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-24fe5a61-089a-43c1-95a7-b8d0f928ccf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f260e9d05241539523dd986ebaaf10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:24.286018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 902/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:23 2022] DELETE /identity/v3/users/98f260e9d05241539523dd986ebaaf10 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:24.404428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:24.404912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:24.405400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:24.407907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 900/1802] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:00:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:00:24.603084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:24.603084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:24.603671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:24.752824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:24.759015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:24.959466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:25.042185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 903/1803] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:25.176615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:25.179270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:25.349001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e2d1-2bba-4037-be8e-297bbb386411 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:25.357142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:25.359002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:25.359468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:25.360461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:25.363370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:25.561368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:25.570957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:25.609152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 901/1804] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:26.725085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:26.727567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:26.749437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ceb4-e2f4-4f37-bc2d-0578ac92e88d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:26.762162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:26.763040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:26.763489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:26.764592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:26.791941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:26.795181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:26.830158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 904/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:28.169198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:28.170885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:28.257698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a27a-1d06-4208-8276-e8e85eadb8f6 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:28.265585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:28.267178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:28.267442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:28.267860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] PATH_INFO: `/v3/projects/6e8609dd93d14cc581470e687381140b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:28.269062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8609dd93d14cc581470e687381140b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:28.271770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:28.355034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:28.362913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8609dd93d14cc581470e687381140b', 'request_id': 'req-98a34233-d6ba-4441-b300-409eb7661093'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.380167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8609dd93d14cc581470e687381140b', 'request_id': 'req-98a34233-d6ba-4441-b300-409eb7661093'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.397096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8609dd93d14cc581470e687381140b', 'request_id': 'req-98a34233-d6ba-4441-b300-409eb7661093'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.416571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] The token cache is being invalidate because project 6e8609dd93d14cc581470e687381140b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:28.417131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.417993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.422947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 902/1806] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:28 2022] DELETE /identity/v3/projects/6e8609dd93d14cc581470e687381140b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:28.424861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:28.447442 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8cba-f6a2-43f4-b11b-3b4c798c3b9b service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:28.563784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:28.564426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:28.565107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:28.565591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] PATH_INFO: `/v3/users/6ee47f031e59408982471e56d0f76308` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:28.567611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee47f031e59408982471e56d0f76308)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:28.573450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:28.610564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:28.612096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:28.636812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34233-d6ba-4441-b300-409eb7661093 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:28.650121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:28.652782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:28.652782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:28.652782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] PATH_INFO: `/v3/projects/2e573d531ac74d808b4a8a9be994e160` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:28.654671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e573d531ac74d808b4a8a9be994e160)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:28.669182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:28.715521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee47f031e59408982471e56d0f76308'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.732347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee47f031e59408982471e56d0f76308'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.769709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee47f031e59408982471e56d0f76308'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.799761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee47f031e59408982471e56d0f76308'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.800680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee47f031e59408982471e56d0f76308'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.809757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e573d531ac74d808b4a8a9be994e160', 'request_id': 'req-3dc85a4b-93dd-41ab-82d8-5c861aba3564'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.818419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 905/1807] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:28 2022] DELETE /identity/v3/users/6ee47f031e59408982471e56d0f76308 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:28.819131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e573d531ac74d808b4a8a9be994e160', 'request_id': 'req-3dc85a4b-93dd-41ab-82d8-5c861aba3564'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.832536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e573d531ac74d808b4a8a9be994e160', 'request_id': 'req-3dc85a4b-93dd-41ab-82d8-5c861aba3564'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.860915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] The token cache is being invalidate because project 2e573d531ac74d808b4a8a9be994e160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:28.861509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.862472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:28.868185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 903/1808] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:28 2022] DELETE /identity/v3/projects/2e573d531ac74d808b4a8a9be994e160 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:28.873112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:28.876750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:29.047866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:29.063917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f1e6-1b94-4f3b-bb8f-ab48137e8c47 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:29.087243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:29.088466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:29.089003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:29.089637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] PATH_INFO: `/v3/users/0c8d59d50e8949caa167140ce1db17b9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:29.096530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8d59d50e8949caa167140ce1db17b9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:29.099949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:29.207852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8d59d50e8949caa167140ce1db17b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.222741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8d59d50e8949caa167140ce1db17b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.246848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8d59d50e8949caa167140ce1db17b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.256663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8d59d50e8949caa167140ce1db17b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.257416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa0fde4-8c77-4ae3-9ed5-0a584037dc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8d59d50e8949caa167140ce1db17b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.265161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:29.267960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:29.274685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:28 2022] DELETE /identity/v3/users/0c8d59d50e8949caa167140ce1db17b9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:29.386819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc85a4b-93dd-41ab-82d8-5c861aba3564 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:29.480575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:29.481234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:29.481543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:29.482581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] PATH_INFO: `/v3/users/c935acbf2a7d478c898082eac44b7332` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:29.483894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c935acbf2a7d478c898082eac44b7332)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:29.487712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:29.489967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:29.573258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c935acbf2a7d478c898082eac44b7332'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.592960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c935acbf2a7d478c898082eac44b7332'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.594763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c935acbf2a7d478c898082eac44b7332'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.616056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c935acbf2a7d478c898082eac44b7332'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.630772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c935acbf2a7d478c898082eac44b7332'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:29.638617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 904/1810] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:29 2022] DELETE /identity/v3/users/c935acbf2a7d478c898082eac44b7332 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:29.643899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:29.644360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:29.644509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:29.668988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:29.670404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:29.696044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:29.698431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:29.894971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 907/1811] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:29.939440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e434-1f2f-4703-bbb5-452d1be564d6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:29.944841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:29.945513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:29.945868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:29.946137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] PATH_INFO: `/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:29.949161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a30cb1b8b4ed0aabc804afa6e4239)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:29.951614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:29.975212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:29.976852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.044087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a30cb1b8b4ed0aabc804afa6e4239', 'request_id': 'req-4791ebf0-e12c-4f98-97d3-073da622de57'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.064516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a30cb1b8b4ed0aabc804afa6e4239', 'request_id': 'req-4791ebf0-e12c-4f98-97d3-073da622de57'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.076259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856de6-220e-4ba1-9810-cb08a10eb685 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.082144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a30cb1b8b4ed0aabc804afa6e4239', 'request_id': 'req-4791ebf0-e12c-4f98-97d3-073da622de57'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.101134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] The token cache is being invalidate because project 1e1a30cb1b8b4ed0aabc804afa6e4239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:30.102262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.103217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4791ebf0-e12c-4f98-97d3-073da622de57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.106651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 905/1812] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:29 2022] DELETE /identity/v3/projects/1e1a30cb1b8b4ed0aabc804afa6e4239 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:30.116207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cb9e1-627d-4039-9a9e-7fb3a6f2ca72 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.116713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cb9e1-627d-4039-9a9e-7fb3a6f2ca72 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.117220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cb9e1-627d-4039-9a9e-7fb3a6f2ca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.155881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0f8cb9e1-627d-4039-9a9e-7fb3a6f2ca72 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:30.157801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f8cb9e1-627d-4039-9a9e-7fb3a6f2ca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.158749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:30.166515 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:30.219546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.220517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.221793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.221793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.226741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.269321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 906/1813] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:30.277632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.278487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.278999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.326852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:30.329149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.339970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 907/1814] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:30.347244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.353379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.358752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.360734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08dde-80dd-4726-bf7b-3d5ee75ede3e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.369392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.370192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.371405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.371405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.372301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:30.372676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.376240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.385830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 908/1815] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:30.395641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 908/1816] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:30.400409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.411550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174280-1937-40ff-ba6c-9885485118ce service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.424343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.425435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.425435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.425768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.426172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.428678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.468415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 909/1817] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:30 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:30.470285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.481153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db2cd9-130f-4e92-8b5a-e32c7a7fdca5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.579850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.580609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.580955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.581291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.582144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.585195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.621169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 909/1818] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:30 2022] POST /identity/v3/users => generated 281 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:30.629413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.643639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.647360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.657255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930de88-a368-48a5-9d0b-d8d7a46943be admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.665913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181989-ec3a-4c62-a1c6-541bfab3e4f8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.669077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.670446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.671004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.671624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.671808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.672496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.672614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.672854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.673387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] PATH_INFO: `/v3/projects/d14a4be427884eeaabda84ee409a3883` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.674727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14a4be427884eeaabda84ee409a3883)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.675075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.676752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.701713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 910/1819] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:30.703380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.723082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b1cba-d0a8-4e8b-b911-d42cad7701d8 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.732672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.734134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.734835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.735690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.736894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.738988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:30.789518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 911/1820] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:30.790721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:30.793073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14a4be427884eeaabda84ee409a3883', 'request_id': 'req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.804026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14a4be427884eeaabda84ee409a3883', 'request_id': 'req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.813316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14a4be427884eeaabda84ee409a3883', 'request_id': 'req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.830397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2a8b-24a3-4e7c-98df-47a39100465f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:30.860567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] The token cache is being invalidate because project d14a4be427884eeaabda84ee409a3883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:30.860867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.862114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2328e509-42ad-4f4a-a019-c2ebaa27e3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:30.867925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 910/1821] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:30 2022] DELETE /identity/v3/projects/d14a4be427884eeaabda84ee409a3883 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:30.869857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505c6d-ad3f-4881-b26a-638622713a23 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.869946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505c6d-ad3f-4881-b26a-638622713a23 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.870236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505c6d-ad3f-4881-b26a-638622713a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.889829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:30.923320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-17505c6d-ad3f-4881-b26a-638622713a23 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:30.926232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-17505c6d-ad3f-4881-b26a-638622713a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:30.958778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:30.959505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:30.959780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:30.960055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] PATH_INFO: `/v3/projects/0e9fcd0b985d49768db00b5051ccce28/users/bd293c040ceb4ed295de78292a0e1415/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:30.982101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9fcd0b985d49768db00b5051ccce28, user_id=bd293c040ceb4ed295de78292a0e1415, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:30.985454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29854ec-1b51-4280-bbef-b90fbc093642 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.008944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 912/1822] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:30 2022] PUT /identity/v3/projects/0e9fcd0b985d49768db00b5051ccce28/users/bd293c040ceb4ed295de78292a0e1415/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:31.023203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.025120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.026869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.049775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 911/1823] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:31.059106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.059540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.059817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.105769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] MFA Rules not processed for user `bd293c040ceb4ed295de78292a0e1415`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:31.107022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:31.114729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:31.114729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:31.125862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:31.237352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 913/1824] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:31.288311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 912/1825] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:31.293154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.301896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.304353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:31.357006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a697b-224a-43b7-9a6c-618cb14e69bf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.365357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.366146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.366498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.366846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.367588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:31.367966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.369735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.414396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 914/1826] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:31.418674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.445531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c020a-d95c-4d72-a35a-a1d129a63355 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.451892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77069-84ff-458a-acea-958945fd773b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.466240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.466975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.467290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.469208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.470466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.471856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.472371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.472955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.475448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.478579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.483413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.486101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.517852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 913/1827] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:31.526445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.530474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:31.535175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 915/1828] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:31 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:31.539516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.571020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c7df-d527-4e5f-bf12-bec3b3572545 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.684492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:31.730940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.731583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.731856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.732126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] PATH_INFO: `/v3/users/bd293c040ceb4ed295de78292a0e1415` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.735531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd293c040ceb4ed295de78292a0e1415)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.752653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.753930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fa293-6861-440c-9fc3-14aea8d4fd59 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.762313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.763317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.763818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.764346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.765246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.767734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.809871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 916/1829] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:31 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:31.815146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.837318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f1f-91e0-4cd4-87a1-2044cf104ada admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.853510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.859091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.860510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.861238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.862299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.864564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.879727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd293c040ceb4ed295de78292a0e1415'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:31.893111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 917/1830] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:31.894703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.900349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd293c040ceb4ed295de78292a0e1415'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:31.901123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd293c040ceb4ed295de78292a0e1415'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:31.933356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01203398-bebb-4bd1-aa89-de72e1ab816c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:31.935239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd293c040ceb4ed295de78292a0e1415'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:31.950088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:31.950825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.951634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.952091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.952914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:31.954917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:31.956985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e58478d0-52f5-4ce5-913c-3c8e6c066b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd293c040ceb4ed295de78292a0e1415'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:31.972977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 918/1831] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:31.974511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:31.979399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 914/1832] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:31 2022] DELETE /identity/v3/users/bd293c040ceb4ed295de78292a0e1415 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:31.980252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:31.981173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:31.981463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:31.982446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:31.997263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eb8f3-26a6-40ab-9ef7-20374f22cc4c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.008079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:32.009881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.056182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:32.104391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.104391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.104391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.104391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] PATH_INFO: `/v3/projects/c5b8be23a05744b39efb04af5019d731/users/922d2ee0a5584384b40a886ded310d30/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.127392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b8be23a05744b39efb04af5019d731, user_id=922d2ee0a5584384b40a886ded310d30, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.130340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882b520-8aa6-4135-a9d3-765409e61c90 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.153192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 919/1833] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:31 2022] PUT /identity/v3/projects/c5b8be23a05744b39efb04af5019d731/users/922d2ee0a5584384b40a886ded310d30/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:32.164632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.166002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.166530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.189257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 915/1834] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:32.217534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] MFA Rules not processed for user `922d2ee0a5584384b40a886ded310d30`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:32.220010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.255909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.258302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.335292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2613707-ecc0-4853-b23c-784b54a4e1b8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.379697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:32.410429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 920/1835] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:32.412299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.414971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.437107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.440576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.440981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.441365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.588447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71ce4c-7e0a-448b-997e-d7ac912195e9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.601967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.603993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.604444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.605827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] PATH_INFO: `/v3/projects/287085a2977447b480850d38f688d1a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.610340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287085a2977447b480850d38f688d1a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.612563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.618123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.621213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.651889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 916/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:32.652815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.687664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d953dd-7919-463a-b013-2ccd2e3bfb33 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.693752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.694379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.694675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.695484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.696402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.698495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.741020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 917/1837] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:32 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:32.742440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.746134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287085a2977447b480850d38f688d1a5', 'request_id': 'req-0b64cda2-e753-4a17-a6ce-d8b6bd618778'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:32.763971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287085a2977447b480850d38f688d1a5', 'request_id': 'req-0b64cda2-e753-4a17-a6ce-d8b6bd618778'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:32.770542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:32.780707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287085a2977447b480850d38f688d1a5', 'request_id': 'req-0b64cda2-e753-4a17-a6ce-d8b6bd618778'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:32.810363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] The token cache is being invalidate because project 287085a2977447b480850d38f688d1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:32.811107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:32.811944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:32.814644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 921/1838] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:32 2022] DELETE /identity/v3/projects/287085a2977447b480850d38f688d1a5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:32.820100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.821538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.855578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943453f-4f49-45e8-9cba-b5a77cd69615 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.862484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.863569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.863996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.864629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.865445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.868180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.920061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64cda2-e753-4a17-a6ce-d8b6bd618778 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.927484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.928289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.928642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.929023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] PATH_INFO: `/v3/users/8c746aacd8e74568ae7019475dfc1043` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.930433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c746aacd8e74568ae7019475dfc1043)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.931579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 918/1839] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:32 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:32.935026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:32.935905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:32.940373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:32.959535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037c1a-9bc0-4ef2-8adb-50b330929f6b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:32.978704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:32.980800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:32.981897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:32.982866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:32.984095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:32.988278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:33.010313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c746aacd8e74568ae7019475dfc1043'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.011982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 919/1840] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:33.013892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.024199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c746aacd8e74568ae7019475dfc1043'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.033614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68661c-3070-470c-9033-09d79923daec admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:33.041467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:33.043489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:33.044001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:33.044543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] PATH_INFO: `/v3/projects/89b7969b045d4b39bc999c4a79cc7694/users/efc4d839e6c0474d84890b48dc671f48/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:33.051165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c746aacd8e74568ae7019475dfc1043'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.073002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c746aacd8e74568ae7019475dfc1043'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.073524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b7969b045d4b39bc999c4a79cc7694, user_id=efc4d839e6c0474d84890b48dc671f48, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:33.074633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c746aacd8e74568ae7019475dfc1043'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.078652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:33.086150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 922/1841] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:32 2022] DELETE /identity/v3/users/8c746aacd8e74568ae7019475dfc1043 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:33.096705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 920/1842] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:33 2022] PUT /identity/v3/projects/89b7969b045d4b39bc999c4a79cc7694/users/efc4d839e6c0474d84890b48dc671f48/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:33.101074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.102820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:33.211792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e42b2-6818-4828-b1be-024aa41f1480 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:33.226899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:33.341298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:33.341968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:33.342260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:33.342534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:33.343288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:33.346001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b72f75-49b8-4dec-9083-f99b345ae24c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:33.365768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 923/1843] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:33.367214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.379375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:33.386634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0cdb1-b72a-40dd-ac2e-be658301db75 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:33.399301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:33.401908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:33.402201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:33.402602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] PATH_INFO: `/v3/projects/89b7969b045d4b39bc999c4a79cc7694/users/efc4d839e6c0474d84890b48dc671f48/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:33.405312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b7969b045d4b39bc999c4a79cc7694, user_id=efc4d839e6c0474d84890b48dc671f48, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:33.408995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:33.424028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 921/1844] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:33 2022] PUT /identity/v3/projects/89b7969b045d4b39bc999c4a79cc7694/users/efc4d839e6c0474d84890b48dc671f48/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:33.438551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:33.438898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:33.439178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:33.475134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.478018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:33.513701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] MFA Rules not processed for user `efc4d839e6c0474d84890b48dc671f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:33.516424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:33.603516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39c44-6001-4df7-affa-7f0d3d041e7d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:33.611630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:33.612617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:33.612899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:33.613174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] PATH_INFO: `/v3/projects/63d54d756bee426ea9e1be740a24308a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:33.614848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d54d756bee426ea9e1be740a24308a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:33.617164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:33.711057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d54d756bee426ea9e1be740a24308a', 'request_id': 'req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.725398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 924/1845] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:33.735929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.754425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d54d756bee426ea9e1be740a24308a', 'request_id': 'req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.757961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:33.784783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d54d756bee426ea9e1be740a24308a', 'request_id': 'req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.814704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] The token cache is being invalidate because project 63d54d756bee426ea9e1be740a24308a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:33.815499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.818098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:33.832452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 922/1846] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:33 2022] DELETE /identity/v3/projects/63d54d756bee426ea9e1be740a24308a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:33.836545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:33.840764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:33.913306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906ad8-dff3-47c6-b665-3b3662a5d349 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:33.993309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2e30-56b6-47f6-9bf8-c3bd1fad0af6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:34.005744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:34.006409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.006686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.006957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] PATH_INFO: `/v3/users/763eedfd54a942429028c19d13f28e2c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.008793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:34.008943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=763eedfd54a942429028c19d13f28e2c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:34.010812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:34.019355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:34.019984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.020259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.020531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.024973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.086024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:34.150225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763eedfd54a942429028c19d13f28e2c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.176121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763eedfd54a942429028c19d13f28e2c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.179108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763eedfd54a942429028c19d13f28e2c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.217822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763eedfd54a942429028c19d13f28e2c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.221834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:34.223432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3197-9cbc-4eb9-b304-17022bfa74e4 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:34.234974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763eedfd54a942429028c19d13f28e2c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.252302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 925/1847] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:34.254732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e34f-b1c0-4246-943a-2cbbff6f2abc None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.255275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e34f-b1c0-4246-943a-2cbbff6f2abc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.256690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 923/1848] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:33 2022] DELETE /identity/v3/users/763eedfd54a942429028c19d13f28e2c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:34.258315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:34.259530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e34f-b1c0-4246-943a-2cbbff6f2abc None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.262747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 926/1849] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:00:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:00:34.262949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.332168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292699d7-525b-4bd8-9d50-8decb674f682 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.332712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292699d7-525b-4bd8-9d50-8decb674f682 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.333196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292699d7-525b-4bd8-9d50-8decb674f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.385448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-292699d7-525b-4bd8-9d50-8decb674f682 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:34.386764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-292699d7-525b-4bd8-9d50-8decb674f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.393317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3266-ff5a-40a4-808e-3c414ee9df4c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:34.407572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:34.409452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.410212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.410647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] PATH_INFO: `/v3/projects/0e9fcd0b985d49768db00b5051ccce28` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.413830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9fcd0b985d49768db00b5051ccce28)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:34.419694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:34.531821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 927/1850] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:34.571697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9fcd0b985d49768db00b5051ccce28', 'request_id': 'req-a938086d-704a-4247-8e7f-5f753d1c91e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.585849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9fcd0b985d49768db00b5051ccce28', 'request_id': 'req-a938086d-704a-4247-8e7f-5f753d1c91e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.593682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9fcd0b985d49768db00b5051ccce28', 'request_id': 'req-a938086d-704a-4247-8e7f-5f753d1c91e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.615878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] The token cache is being invalidate because project 0e9fcd0b985d49768db00b5051ccce28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:34.616526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.617772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:34.621191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 924/1851] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:34 2022] DELETE /identity/v3/projects/0e9fcd0b985d49768db00b5051ccce28 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:34.629191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cb32f-ce05-4144-ac99-c371bdf7f5ca None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.630043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cb32f-ce05-4144-ac99-c371bdf7f5ca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.630563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cb32f-ce05-4144-ac99-c371bdf7f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.672398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b79cb32f-ce05-4144-ac99-c371bdf7f5ca None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:34.675166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b79cb32f-ce05-4144-ac99-c371bdf7f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.760795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:34.762988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.872640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 928/1852] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:34.874168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf328-16e1-45be-b438-378385f78b48 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.874628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf328-16e1-45be-b438-378385f78b48 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.874906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf328-16e1-45be-b438-378385f78b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.888867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:34.897244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-21caf328-16e1-45be-b438-378385f78b48 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:34.899179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-21caf328-16e1-45be-b438-378385f78b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:34.913922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 929/1853] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:34.919317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caf328-16e1-45be-b438-378385f78b48 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:34.936679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caf328-16e1-45be-b438-378385f78b48 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:34.946034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:34.947089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:34.947381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:34.947641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:34.948319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:34.948889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:34.950688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:34.970784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 930/1854] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:34.971733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:34.987826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d83d6f-c0e7-4eaa-9f73-84c24fb6fc6d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.003161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.003914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.004203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.004482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.005278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.007365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.023105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938086d-704a-4247-8e7f-5f753d1c91e5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.032489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:35.036119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.037869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.037869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.037869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.040789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.068139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 931/1855] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:34 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:35.074203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.080985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.087314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.118141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 925/1856] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:35.195423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac8e6-77ea-4160-afad-db173dda4271 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.201545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.202241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.202518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.203898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.204619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.208729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.244338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 932/1857] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:35.248912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.261969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832125-0e33-482d-8a48-207010e609a3 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.267551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.268349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.268817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.269298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.270550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.272182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.303283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.305041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.334224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 926/1858] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:35.335563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.341553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351024d2-6b01-4f90-8e3b-26870f397e09 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.351855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791063cf-fbe6-46f6-9ebe-2399863d90d9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.352647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.353296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.353722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.354120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] PATH_INFO: `/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.356052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b5e30b0a0e4fbe94214bea9c384b43)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.359926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.360453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.360715 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.361148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.361712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.362499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.364458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.377536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 927/1859] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:35.381703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.392322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9d9a3-8fea-4cb9-b94e-f6557416d2c7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.399081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.399942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.400377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.400829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] PATH_INFO: `/v3/projects/8b00c9d3edc34a05a07007ff8bd23985/users/c16faa6cdb07491d9c0b175cd4d73917/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.419884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b00c9d3edc34a05a07007ff8bd23985, user_id=c16faa6cdb07491d9c0b175cd4d73917, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.423001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b5e30b0a0e4fbe94214bea9c384b43', 'request_id': 'req-42ddc174-11f6-4a44-a019-06099d8a0309'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:35.423704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfdf59-edf6-4531-b647-7f20747903b1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.436606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b5e30b0a0e4fbe94214bea9c384b43', 'request_id': 'req-42ddc174-11f6-4a44-a019-06099d8a0309'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:35.441531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 928/1860] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:35 2022] PUT /identity/v3/projects/8b00c9d3edc34a05a07007ff8bd23985/users/c16faa6cdb07491d9c0b175cd4d73917/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:35.446066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b5e30b0a0e4fbe94214bea9c384b43', 'request_id': 'req-42ddc174-11f6-4a44-a019-06099d8a0309'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:35.453533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.454282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.454790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.462856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] The token cache is being invalidate because project 18b5e30b0a0e4fbe94214bea9c384b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:35.463152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:35.463953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-42ddc174-11f6-4a44-a019-06099d8a0309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:35.466249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 933/1861] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:35 2022] DELETE /identity/v3/projects/18b5e30b0a0e4fbe94214bea9c384b43 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:35.473325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d72d-6e8d-4c7b-9b0f-a36099e91767 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.473325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d72d-6e8d-4c7b-9b0f-a36099e91767 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.473756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d72d-6e8d-4c7b-9b0f-a36099e91767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.492446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] MFA Rules not processed for user `c16faa6cdb07491d9c0b175cd4d73917`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:35.493904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.502657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c860d72d-6e8d-4c7b-9b0f-a36099e91767 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:35.504141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c860d72d-6e8d-4c7b-9b0f-a36099e91767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.583832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 934/1862] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:35.594201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.594201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.594409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.611054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 929/1863] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:35.612040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.613969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.620425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:35.631372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b6498-858d-4e1b-8e28-8046b187faf0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.636702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:35.637739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.638459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.638806 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.639196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.640248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.642281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:35.642928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.652100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 935/1864] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:35.656051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.685460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b1d97-ef64-4644-be09-e7de200680a8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.685460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.685460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.685460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.685963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.685963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:35.685963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.685963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.705587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 936/1865] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:00:35.706969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.712513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 930/1866] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:35.713328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:35.720288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca8e4-091a-4816-adb9-86ca7e0611e4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.805526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:35.806316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:35.806446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:35.806711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:35.807575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:35.811395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:35.820293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:35.870099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 937/1867] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:35.870485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4540e6-54ed-402d-b7d9-8c44509247ea admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:35.870630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.017320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e6d38-695f-461d-8b2a-cbfb115e1914 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.021733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.022831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.022831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.023130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.023895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.025383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.026275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.027077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.028180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.028708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.029636 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.033176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.058674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 931/1868] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/users => generated 289 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:36.059998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.063311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:36.067578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 938/1869] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:35 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:36.068717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.082640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3ab7-7595-4ee0-b307-982415c0a3ec admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.091947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.092720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.093143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.094136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.095246 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.097438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.129063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 939/1870] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:36.130281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.143164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900100-c8ee-44e3-9727-401fd82ee311 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.149539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.149929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.150264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.150639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.151398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.153352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.168881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 940/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:36.168881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.180503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f174d-1f9c-4b47-8b37-430f1c2449df admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.181535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f9c-5ad9-4aab-aab7-174c91b322cf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.185212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.185968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.186309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.186650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.188975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.189709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:36.189975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.190324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.190665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.191641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.193301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.204354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 941/1872] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:36.205336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.217417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb457e-869a-48ca-80be-6662181fcd33 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.224999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.225225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.225529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.225902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.226969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.228478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.243839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 942/1873] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:36.243839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.259142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe2b1-3251-481f-aca9-80a6df0cc9cb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.266034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.268630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.269004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.269355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] PATH_INFO: `/v3/projects/cd4c366e15234ecab4c127197e0abad8/users/f0cb7908b0d5444990c013e04def42ab/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.277972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.280204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.286450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c366e15234ecab4c127197e0abad8, user_id=f0cb7908b0d5444990c013e04def42ab, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.289545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3c8c8-455a-44f3-8542-cbc6ebace6d5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.291310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 932/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:36.291951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.292809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:36.305941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211ec6-1bcc-4bb7-844c-f06feb5e7f4a service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.311345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 943/1875] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:36 2022] PUT /identity/v3/projects/cd4c366e15234ecab4c127197e0abad8/users/f0cb7908b0d5444990c013e04def42ab/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:36.323187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.323769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.324327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.337436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:36.366880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] MFA Rules not processed for user `f0cb7908b0d5444990c013e04def42ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:36.368249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:36.394167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.394949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.395295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.395638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] PATH_INFO: `/v3/projects/9a45b90b5e964fc9adc8bb1542d31072/users/6fd9b840bfe64a42b48b7d21c17115d0/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.413963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a45b90b5e964fc9adc8bb1542d31072, user_id=6fd9b840bfe64a42b48b7d21c17115d0, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.417344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ee098-7ef7-4d00-9576-c510163ef710 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.438955 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 933/1876] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:36 2022] PUT /identity/v3/projects/9a45b90b5e964fc9adc8bb1542d31072/users/6fd9b840bfe64a42b48b7d21c17115d0/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:36.450381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.450603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.450911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.453529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 944/1877] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:36.457763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.479707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1527485-d542-477c-b48d-bc3a002534fc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.492385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] MFA Rules not processed for user `6fd9b840bfe64a42b48b7d21c17115d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:36.493653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:36.563826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.564807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.565348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.565794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.566686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.569068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.580154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 934/1878] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:36.585683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.598305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e024272-d988-4a07-be9c-d6c14d7cb19f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.605085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.605085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.605085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.605381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 945/1879] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:36.605474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.605629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.610154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.611158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.645472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 935/1880] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:36.649570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.695132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576d8ff-a7d4-44ea-ac78-9e614d93ddb2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.711163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:36.740959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d3b9-f516-43a0-9f31-5662634d7164 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.747001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.747607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.747881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.748150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.748786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.751921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.773692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.774792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.774955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.776482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.776603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 936/1881] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:36.776763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.778638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.780691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.790908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:36.798620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285dd0d-31cf-4ed7-8b02-daeb60d4a318 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.806702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.808260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.808544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.808813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.809460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.812921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 946/1882] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:36 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:36.813136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.814270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.837509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 937/1883] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:36.837741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815331-dc68-42d8-a533-c3355a081f45 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.837849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.837938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.837938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.837938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.837938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.840513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.840769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.841596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7e3a-f2de-4ad6-bc26-b08a48537e48 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.847471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.848136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.848411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.848687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] PATH_INFO: `/v3/projects/fb659f3cecfe41eca9877fbea18367d6/users/4069f8f2afe949c78ee0c0e5fc970235/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.857541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 947/1884] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:36.859118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.866604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb659f3cecfe41eca9877fbea18367d6, user_id=4069f8f2afe949c78ee0c0e5fc970235, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.869293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.871053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ff50-1be8-4fb5-bc9b-b468af819c7c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:36.876984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:36.877360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:36.877671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:36.877938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] PATH_INFO: `/v3/projects/40636106cad74730bb067789e9a956a1/users/85254b67f7144fdc8ed6d35214935ffd/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:36.886270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 938/1885] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:36 2022] PUT /identity/v3/projects/fb659f3cecfe41eca9877fbea18367d6/users/4069f8f2afe949c78ee0c0e5fc970235/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:36.890080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:36.898256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40636106cad74730bb067789e9a956a1, user_id=85254b67f7144fdc8ed6d35214935ffd, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:36.901216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:36.924523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 948/1886] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:36 2022] PUT /identity/v3/projects/40636106cad74730bb067789e9a956a1/users/85254b67f7144fdc8ed6d35214935ffd/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:36.925795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.025144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7050e84-bc26-4610-9fc9-bacac21cecbe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.027680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8032ed-2928-4c22-a8b2-6959f5f9097b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.034917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.035279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.035744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.036039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.036318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.036993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.037202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.038207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.038924 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.041551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.042772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.044489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.054787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 939/1887] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:37.060091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.067577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 949/1888] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:37.072895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801e147-62f8-42f0-b7df-92750f431de6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.077590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.077745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.079112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.079419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.079698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] PATH_INFO: `/v3/projects/fb659f3cecfe41eca9877fbea18367d6/users/4069f8f2afe949c78ee0c0e5fc970235/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.082014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb659f3cecfe41eca9877fbea18367d6, user_id=4069f8f2afe949c78ee0c0e5fc970235, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.085538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a421eb1-68e4-47e7-bc61-55ae1e620be3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.095849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009251d-b489-490a-bc70-b2b48c91f754 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.112175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 940/1889] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:37 2022] PUT /identity/v3/projects/fb659f3cecfe41eca9877fbea18367d6/users/4069f8f2afe949c78ee0c0e5fc970235/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:37.124151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.124151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.124522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.173870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] MFA Rules not processed for user `4069f8f2afe949c78ee0c0e5fc970235`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:37.175817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:37.193616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.194737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.195192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.195630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] PATH_INFO: `/v3/projects/40636106cad74730bb067789e9a956a1/users/85254b67f7144fdc8ed6d35214935ffd/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.197850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40636106cad74730bb067789e9a956a1, user_id=85254b67f7144fdc8ed6d35214935ffd, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.200871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242603d-42dd-4cfd-b364-cfc9ac1a68f1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.215700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:37.226719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 950/1890] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:37 2022] PUT /identity/v3/projects/40636106cad74730bb067789e9a956a1/users/85254b67f7144fdc8ed6d35214935ffd/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:37.238258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.238704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.239030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.266281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 941/1891] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:37.279305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] MFA Rules not processed for user `85254b67f7144fdc8ed6d35214935ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:37.280540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:37.283304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.284834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:37.336512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:37.369432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641aa3-dffe-4757-abd2-e921f124ebd9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.373169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 951/1892] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:37.386424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.441370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.442385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.442802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.443170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.455618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d09ad8-664c-41de-8cdf-45f1d60e4774 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.460401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.461241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.461670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.462039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.517151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.518651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.529148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 942/1893] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:37.530895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.532839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.543171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 952/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:37.684488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:37.694232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bf89-e04b-4d98-bf49-775f79560c9c service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:37.699267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:37.700460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:37.700929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:37.701358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:37.811771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:37.814051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:37.826614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 943/1895] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:39.561700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:39.572081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56b22-438d-45b3-b6c3-74f1b23091cb service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:39.576571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:39.577198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:39.577477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:39.577777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:39.628925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:39.652412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:39.653908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:39.668430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 953/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:40.631841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:40.642345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225f3b-39d1-4663-89ad-a9f7ccf5d37e service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:40.646584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:40.647428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:40.647803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:40.648168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:40.659192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:40.660903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8d44c-3add-4a70-972b-c08714f8cf70 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:40.683891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 944/1897] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:41.198136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:41.199687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:41.365317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf31f-f316-4c08-8022-0b80fc663fe6 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:41.370971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:41.371762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:41.372137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:41.372556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] PATH_INFO: `/v3/users/922d2ee0a5584384b40a886ded310d30` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:41.374071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922d2ee0a5584384b40a886ded310d30)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:41.379001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:41.461725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922d2ee0a5584384b40a886ded310d30'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:41.480121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922d2ee0a5584384b40a886ded310d30'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:41.507633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922d2ee0a5584384b40a886ded310d30'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:41.523627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922d2ee0a5584384b40a886ded310d30'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:41.526012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922d2ee0a5584384b40a886ded310d30'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:41.534898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 954/1898] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:41 2022] DELETE /identity/v3/users/922d2ee0a5584384b40a886ded310d30 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:41.542352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:41.542638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:41.543472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:41.570543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:41.571792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:41.610475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:41.737161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 945/1899] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:41.748800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:41.750356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:41.863816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444a6f-af88-4c1e-8bfd-50e31342c9c5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:41.870218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:41.871622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:41.872401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:41.873007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:41.889242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:41.891692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:41.900025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:41.911880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 955/1900] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:42.516850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:42.518888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:42.533510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d47842-fdf8-46d7-b19b-8f7899cdb74b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:42.538752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:42.539634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:42.540034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:42.540305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] PATH_INFO: `/v3/projects/c5b8be23a05744b39efb04af5019d731` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:42.541709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b8be23a05744b39efb04af5019d731)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:42.543760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:42.604164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b8be23a05744b39efb04af5019d731', 'request_id': 'req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.611792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b8be23a05744b39efb04af5019d731', 'request_id': 'req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.618437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b8be23a05744b39efb04af5019d731', 'request_id': 'req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.638441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] The token cache is being invalidate because project c5b8be23a05744b39efb04af5019d731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:42.638887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.639671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.642389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 946/1901] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:42 2022] DELETE /identity/v3/projects/c5b8be23a05744b39efb04af5019d731 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:42.646761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:42.659587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635d19b-f85d-42e4-9fcc-a50218063704 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:42.731910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:42.732575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:42.732857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:42.733134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] PATH_INFO: `/v3/users/efc4d839e6c0474d84890b48dc671f48` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:42.734558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc4d839e6c0474d84890b48dc671f48)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:42.736555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:42.806693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc4d839e6c0474d84890b48dc671f48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.818918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc4d839e6c0474d84890b48dc671f48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.841023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc4d839e6c0474d84890b48dc671f48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.850022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc4d839e6c0474d84890b48dc671f48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.850783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc4d839e6c0474d84890b48dc671f48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:42.861768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 956/1902] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:42 2022] DELETE /identity/v3/users/efc4d839e6c0474d84890b48dc671f48 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:43.221002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:43.223028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.242804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29881b9-4b0e-4623-81ff-0d0f6b88c6a0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:43.339534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:43.340683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.341094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.341503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] PATH_INFO: `/v3/projects/89b7969b045d4b39bc999c4a79cc7694` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.342877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b7969b045d4b39bc999c4a79cc7694)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:43.345608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:43.388908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:43.390754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.407534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d43-986d-432d-9331-9fdd7ae8c0ce admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:43.431581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b7969b045d4b39bc999c4a79cc7694', 'request_id': 'req-6096f944-a5ec-4be3-bfc6-31558e65ccc2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.441087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b7969b045d4b39bc999c4a79cc7694', 'request_id': 'req-6096f944-a5ec-4be3-bfc6-31558e65ccc2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.442743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:43.449979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b7969b045d4b39bc999c4a79cc7694', 'request_id': 'req-6096f944-a5ec-4be3-bfc6-31558e65ccc2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.467174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] The token cache is being invalidate because project 89b7969b045d4b39bc999c4a79cc7694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:43.467464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.468100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6096f944-a5ec-4be3-bfc6-31558e65ccc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.470389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 947/1903] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:43 2022] DELETE /identity/v3/projects/89b7969b045d4b39bc999c4a79cc7694 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:43.485596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc09246-490b-4608-b00d-175e40dbe1c8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.485887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc09246-490b-4608-b00d-175e40dbe1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.491650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:43.492374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.494573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.494573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] PATH_INFO: `/v3/users/6fd9b840bfe64a42b48b7d21c17115d0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.494786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc09246-490b-4608-b00d-175e40dbe1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.495323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd9b840bfe64a42b48b7d21c17115d0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:43.498293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:43.533535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6fc09246-490b-4608-b00d-175e40dbe1c8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:43.534776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6fc09246-490b-4608-b00d-175e40dbe1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.542945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:43.552107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 948/1904] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:43.560253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.560756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.561218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.612163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd9b840bfe64a42b48b7d21c17115d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.616970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:43.620116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.626762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd9b840bfe64a42b48b7d21c17115d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.633948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 949/1905] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:43.637862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:43.648514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379bfa5-121d-4cbf-b8e2-89d1e43485a5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:43.653849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:43.654604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.654952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.655298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.656656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:43.657045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:43.658013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd9b840bfe64a42b48b7d21c17115d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.658931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:43.670564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd9b840bfe64a42b48b7d21c17115d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.671603 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a490dac-c4db-4883-9f00-b94a6074848e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd9b840bfe64a42b48b7d21c17115d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:43.673017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 950/1906] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:43.677404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:43.681190 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.684287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 957/1907] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:43 2022] DELETE /identity/v3/users/6fd9b840bfe64a42b48b7d21c17115d0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:43.689188 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.689476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.689797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.702150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b869501-fca9-47b5-b28d-e77beefe8677 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:43.711627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:43.713986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.840180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:43.842280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:43.842838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:43.846335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:43.846949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 958/1908] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:43.847579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:43.851988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:43.861292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:43.864663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:43.899508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 951/1909] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:43.904898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.020749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38e3f4-82cb-48d0-a6d8-692191c99895 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.065927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95345-1bde-4353-a71f-74bfd57b2bbf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.072468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.073250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.073571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.073878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.075339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.079828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.119066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.120055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.120515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.120995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.135973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 952/1910] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:43 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:44.142602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.146183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.147925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.154649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:44.156793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfa58-abd2-4641-899b-dee07dbdf967 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.167582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.168880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.169402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.170040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.171878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.175650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.175808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 959/1911] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:44.191656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 953/1912] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:44.196984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.209846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef951-f06c-4b4c-8c1d-039942d31043 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.223348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.226829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.227490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.227992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.230090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.233020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dd83-9b6c-4bf3-b099-e4b000a9a797 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.254819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 960/1913] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:44.259408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.277455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4153e2-d6ee-48e0-9ae1-f80fddb4b9ce admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.298610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.301935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.304758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.305236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] PATH_INFO: `/v3/projects/f5892878acee469ab648b36dc7d39f9f/users/29f7830b7ba549f28520bdbc65de3939/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.356915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5892878acee469ab648b36dc7d39f9f, user_id=29f7830b7ba549f28520bdbc65de3939, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.361416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.373759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:44.390445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 954/1914] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:44 2022] PUT /identity/v3/projects/f5892878acee469ab648b36dc7d39f9f/users/29f7830b7ba549f28520bdbc65de3939/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:44.405637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.407751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.408507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.471189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] MFA Rules not processed for user `29f7830b7ba549f28520bdbc65de3939`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:44.472622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:44.622563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.624776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:44.696322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 961/1915] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:44.714787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.719314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:44.796867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2226-81fc-43be-af79-8c69a1ce63c3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.816233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.817237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.817748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.818930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] PATH_INFO: `/v3/projects/9a45b90b5e964fc9adc8bb1542d31072` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.821648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a45b90b5e964fc9adc8bb1542d31072)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.825542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.848024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b0d28-f934-451d-b8d8-e97dd3daf7ee None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.854397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:44.855586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:44.856013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:44.856426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:44.871191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:44.872090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:44.883553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 962/1916] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:44.904837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.918505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f3371-1014-4060-94a7-1f836cd559bb service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:44.924874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a45b90b5e964fc9adc8bb1542d31072', 'request_id': 'req-9befc95c-751c-4c49-8097-9bca7a7632fc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:44.933770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a45b90b5e964fc9adc8bb1542d31072', 'request_id': 'req-9befc95c-751c-4c49-8097-9bca7a7632fc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:44.950213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a45b90b5e964fc9adc8bb1542d31072', 'request_id': 'req-9befc95c-751c-4c49-8097-9bca7a7632fc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:44.979661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] The token cache is being invalidate because project 9a45b90b5e964fc9adc8bb1542d31072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:44.980339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:44.981118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:44.983144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 955/1917] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:44 2022] DELETE /identity/v3/projects/9a45b90b5e964fc9adc8bb1542d31072 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:44.987796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:44.990400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.041299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:45.042052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.042472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.042826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] PATH_INFO: `/v3/users/29f7830b7ba549f28520bdbc65de3939` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.044107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f7830b7ba549f28520bdbc65de3939)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:45.046296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:45.080457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:45.137166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befc95c-751c-4c49-8097-9bca7a7632fc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:45.141913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f7830b7ba549f28520bdbc65de3939'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.148276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:45.149627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.150924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.151603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] PATH_INFO: `/v3/users/4069f8f2afe949c78ee0c0e5fc970235` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.153166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4069f8f2afe949c78ee0c0e5fc970235)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:45.154073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f7830b7ba549f28520bdbc65de3939'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.157006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:45.169259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f7830b7ba549f28520bdbc65de3939'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.177720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f7830b7ba549f28520bdbc65de3939'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.178467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f7830b7ba549f28520bdbc65de3939'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.188882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 963/1918] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:44 2022] DELETE /identity/v3/users/29f7830b7ba549f28520bdbc65de3939 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:45.189846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:45.191239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.222784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:45.246947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4069f8f2afe949c78ee0c0e5fc970235'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.259474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4069f8f2afe949c78ee0c0e5fc970235'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.260599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4069f8f2afe949c78ee0c0e5fc970235'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.272753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d0f0-6f55-472c-98cf-4ffa49c6f60e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:45.275111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4069f8f2afe949c78ee0c0e5fc970235'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.278186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:45.278907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.279254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.279595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] PATH_INFO: `/v3/users/c16faa6cdb07491d9c0b175cd4d73917` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.281004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16faa6cdb07491d9c0b175cd4d73917)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:45.283012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:45.283748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a36a9352-7f31-49b6-881c-7a3ca21f881e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4069f8f2afe949c78ee0c0e5fc970235'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.291193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 956/1919] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:44 2022] DELETE /identity/v3/users/4069f8f2afe949c78ee0c0e5fc970235 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:45.295909 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.296277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.297554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.333457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:45.338783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.360913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16faa6cdb07491d9c0b175cd4d73917'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.373080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16faa6cdb07491d9c0b175cd4d73917'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.407958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16faa6cdb07491d9c0b175cd4d73917'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.420949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16faa6cdb07491d9c0b175cd4d73917'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.422496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d55157bf-80e0-45ad-8c69-427551b5d545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16faa6cdb07491d9c0b175cd4d73917'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:45.434455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 964/1920] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:45 2022] DELETE /identity/v3/users/c16faa6cdb07491d9c0b175cd4d73917 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:45.436099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.436496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.436939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.450047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 957/1921] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:45.461758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:45.463051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.467322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:45.469120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.478727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:45.567701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 965/1922] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:45.572950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b20eb-04b1-4662-aeb0-d6ee5659fc2c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:45.590076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:45.641370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:45.642024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.642305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.642694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.661172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:45.665373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:45.677645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757ee3-a478-4cb4-8ce2-31e838a24ec0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:45.682774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 958/1923] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:45.682967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:45.683430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:45.683711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:45.683987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:45.695794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:45.697254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aaa24-dd67-445c-be85-b5c6cc8ceb04 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:45.709684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 966/1924] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:45.976758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:45.978569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:45.990727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:45.995910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8593b-397b-440f-b5b3-e628d4bd0076 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.005019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.005944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.007326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.034835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] PATH_INFO: `/v3/projects/fb659f3cecfe41eca9877fbea18367d6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.042659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb659f3cecfe41eca9877fbea18367d6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.045093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.176748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb659f3cecfe41eca9877fbea18367d6', 'request_id': 'req-7480781d-c30e-4f65-9ee8-0e3784938975'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.188054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb659f3cecfe41eca9877fbea18367d6', 'request_id': 'req-7480781d-c30e-4f65-9ee8-0e3784938975'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.195639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb659f3cecfe41eca9877fbea18367d6', 'request_id': 'req-7480781d-c30e-4f65-9ee8-0e3784938975'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.212034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] The token cache is being invalidate because project fb659f3cecfe41eca9877fbea18367d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:46.212375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.213167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7480781d-c30e-4f65-9ee8-0e3784938975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.221394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 959/1925] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:45 2022] DELETE /identity/v3/projects/fb659f3cecfe41eca9877fbea18367d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:46.223543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.223839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.224118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.247535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:46.249134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:46.336291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 967/1926] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:46.346384 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.347186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.347509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.379933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:46.381739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:46.397354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 960/1927] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:46.401657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.415134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5912eb-f237-4347-b1eb-a0e45630c946 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.420722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.422069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.422360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.422676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.423884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:46.423884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.425536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.459464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 968/1928] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:46.460729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.473693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea599-006e-4ddf-9a22-87bb110217a5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.480326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.481327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.481529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.481961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.482575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.486003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.536808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 961/1929] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:46 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:46.541239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.558024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a50bd-cc35-4af3-8f0a-76880f15d724 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.574154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.580296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:46.652902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:46.689278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.690495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.691066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.691830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.692624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.695000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.705134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655529-a941-4673-a584-9fec360e8c7b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.710823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.711927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.712225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.712570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] PATH_INFO: `/v3/projects/f5892878acee469ab648b36dc7d39f9f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.713942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5892878acee469ab648b36dc7d39f9f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.716074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.732222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 969/1930] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:46 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:46.734638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.737250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:46.756993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3d54-8f7b-4268-9186-6f105c1cdb44 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:46.768880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:46.769133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.769510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.770276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] PATH_INFO: `/v3/projects/8b00c9d3edc34a05a07007ff8bd23985` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:46.784923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b00c9d3edc34a05a07007ff8bd23985)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:46.788543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:46.831339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5892878acee469ab648b36dc7d39f9f', 'request_id': 'req-4643daed-dbc5-4f8b-b2dd-4c7868a26891'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.848629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5892878acee469ab648b36dc7d39f9f', 'request_id': 'req-4643daed-dbc5-4f8b-b2dd-4c7868a26891'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.865954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:46.868402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5892878acee469ab648b36dc7d39f9f', 'request_id': 'req-4643daed-dbc5-4f8b-b2dd-4c7868a26891'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.903551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] The token cache is being invalidate because project f5892878acee469ab648b36dc7d39f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:46.903551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.908284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b00c9d3edc34a05a07007ff8bd23985', 'request_id': 'req-3c5f8687-f347-48a5-befb-c029552d2677'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.909549 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.917535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 962/1931] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:46 2022] DELETE /identity/v3/projects/f5892878acee469ab648b36dc7d39f9f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:46.919654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:46.926407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:46.939705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b00c9d3edc34a05a07007ff8bd23985', 'request_id': 'req-3c5f8687-f347-48a5-befb-c029552d2677'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.948910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b00c9d3edc34a05a07007ff8bd23985', 'request_id': 'req-3c5f8687-f347-48a5-befb-c029552d2677'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.982181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] The token cache is being invalidate because project 8b00c9d3edc34a05a07007ff8bd23985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:46.982484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.984966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c5f8687-f347-48a5-befb-c029552d2677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:46.989123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 970/1932] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:46 2022] DELETE /identity/v3/projects/8b00c9d3edc34a05a07007ff8bd23985 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:46.989862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:46.990227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:46.991090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.044582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:47.046485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.101336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643daed-dbc5-4f8b-b2dd-4c7868a26891 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.191930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 971/1933] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:47.193671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.195232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.213359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed4af-5434-47a4-9b1c-05a9be8dcc82 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.220120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.221549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.222073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.222837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] PATH_INFO: `/v3/users/f0cb7908b0d5444990c013e04def42ab` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.224775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cb7908b0d5444990c013e04def42ab)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.227470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.243657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.244391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.244738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.245100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.246006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.247643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bea5-321e-40bc-ad14-44a303fdc910 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.263250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 963/1934] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:47.263250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.263250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.263250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.304008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:47.307659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.322614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cb7908b0d5444990c013e04def42ab'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:47.328812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 964/1935] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:47.329712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.335192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.336177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cb7908b0d5444990c013e04def42ab'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:47.338810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:47.358475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e24e6-d632-4ba0-96f2-a1ff4d22c26a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.361470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cb7908b0d5444990c013e04def42ab'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:47.368172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.368803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.369456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.369748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.370402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.373179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.388573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cb7908b0d5444990c013e04def42ab'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:47.390760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cb7908b0d5444990c013e04def42ab'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:47.395899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 965/1936] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:47.395899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.397844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.412208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 972/1937] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:47 2022] DELETE /identity/v3/users/f0cb7908b0d5444990c013e04def42ab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:47.415480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.420727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560f63-8b9d-4fb6-8855-470d79762f97 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.421993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.520447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.521805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.523670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.524682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.528468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:47.529578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.536792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.570071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045cd32-bdf2-4446-95db-02e551e92051 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.575797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.576466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.577064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.577432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] PATH_INFO: `/v3/projects/2dcad2cf96cb40c5ae118a542cb940c9/users/880b9da232b3482bac8bc0c23afcaab5/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.581783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 966/1938] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:47.583915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.596557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcad2cf96cb40c5ae118a542cb940c9, user_id=880b9da232b3482bac8bc0c23afcaab5, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.599210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3374ea-bb7b-4ec5-81da-524ce9d9769e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.599568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24286dc-dadd-477c-a833-e9e179d5d49f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.607405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.610925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.611367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.611738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.612494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.615432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.628472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:47.631824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 973/1939] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:47 2022] PUT /identity/v3/projects/2dcad2cf96cb40c5ae118a542cb940c9/users/880b9da232b3482bac8bc0c23afcaab5/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:47.644362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.644724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.645073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.670601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 967/1940] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:47 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:47.675276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.693630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] MFA Rules not processed for user `880b9da232b3482bac8bc0c23afcaab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:47.695956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.804020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 974/1941] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:00:47.814561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.815880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce6-b8ca-49ff-ac45-536106b666f8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.816254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:47.822422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.823315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.823728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.824153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.825127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.827455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.861874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 968/1942] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:47 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:47.868395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.896637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4130b-ed31-4ea7-bef7-eae6485f9e25 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.904026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.904927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.905374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.906610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.908030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.910736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.916438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:47.926309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959517-52d5-4082-beaf-480773a22fb3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.927847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 969/1943] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:47.931789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:47.934916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.935916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.936391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.937807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.950434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03977d-57ed-4f84-8ed7-b364364c4a21 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:47.951002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.953165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:47.967906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:47.969244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:47.970520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:47.973006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:47.974541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:47.982079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 975/1944] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:47.982659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.003594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:48.015032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 970/1945] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:48.017232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef65-b3fa-4cd8-8c04-acccb8215eaa service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:48.020153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:48.032899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4e7a-85bd-4bd8-8998-2ad350ff023c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:48.041198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:48.041995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.042392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.043004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] PATH_INFO: `/v3/users/880b9da232b3482bac8bc0c23afcaab5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.045059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:48.046078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880b9da232b3482bac8bc0c23afcaab5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:48.047882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.048726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.049436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.049875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] PATH_INFO: `/v3/projects/04ffb095c9264d84802da66527c9d60e/users/0dfcbc55c895439c951310dd6aac324c/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.096702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ffb095c9264d84802da66527c9d60e, user_id=0dfcbc55c895439c951310dd6aac324c, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:48.096702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5b604-9d19-49cc-82dd-c9d913a6a14c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.151776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 971/1946] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:48 2022] PUT /identity/v3/projects/04ffb095c9264d84802da66527c9d60e/users/0dfcbc55c895439c951310dd6aac324c/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:48.153473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.154505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.154891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.177335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880b9da232b3482bac8bc0c23afcaab5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.189009 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880b9da232b3482bac8bc0c23afcaab5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.224659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] MFA Rules not processed for user `0dfcbc55c895439c951310dd6aac324c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:48.224959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880b9da232b3482bac8bc0c23afcaab5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.226153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:48.246053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880b9da232b3482bac8bc0c23afcaab5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.246806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-67950e0d-0b48-40ee-a03e-3a0cd413dd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880b9da232b3482bac8bc0c23afcaab5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.262553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 976/1947] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:48 2022] DELETE /identity/v3/users/880b9da232b3482bac8bc0c23afcaab5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:48.264666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.264955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.265901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.331513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:48.333593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:48.395414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 972/1948] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:48.407880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:48.409417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:48.464097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:48.479838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 977/1949] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:48.491674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:48.496094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:48.529161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810577a-3bba-4b68-a556-8deb61f1cd64 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:48.645797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:48.646800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.647988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.651961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.668825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149030-60cd-4086-a61c-154b3c50cbc1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:48.693651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:48.696992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.697889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.699087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.723626 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:48.725146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.742002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 978/1950] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:48.743451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:48.745240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:48.759228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:48.766711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c594-3d14-4768-9807-b31c0ee8564d service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:48.773928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:48.774632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:48.775030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:48.775383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] PATH_INFO: `/v3/projects/cd4c366e15234ecab4c127197e0abad8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:48.776952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4c366e15234ecab4c127197e0abad8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:48.779957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.790359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:48.792326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:48.819529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 973/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:48.924309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4c366e15234ecab4c127197e0abad8', 'request_id': 'req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.941617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4c366e15234ecab4c127197e0abad8', 'request_id': 'req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.953216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4c366e15234ecab4c127197e0abad8', 'request_id': 'req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.983019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] The token cache is being invalidate because project cd4c366e15234ecab4c127197e0abad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:48.983456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.985865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:48.988382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 979/1952] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:48 2022] DELETE /identity/v3/projects/cd4c366e15234ecab4c127197e0abad8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:48.992276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:49.019045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803ebd-0286-4708-8409-3ac83aba845f service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:49.197586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:49.201548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.202417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.203139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] PATH_INFO: `/v3/users/85254b67f7144fdc8ed6d35214935ffd` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.206333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85254b67f7144fdc8ed6d35214935ffd)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:49.208346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:49.321781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:49.386257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:49.388121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:49.390154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85254b67f7144fdc8ed6d35214935ffd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.409657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2747e-cd5b-44b1-9c87-80e8af6a37ac admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:49.422348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:49.423327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.423818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.426106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] PATH_INFO: `/v3/projects/2dcad2cf96cb40c5ae118a542cb940c9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.428044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85254b67f7144fdc8ed6d35214935ffd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.429363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcad2cf96cb40c5ae118a542cb940c9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:49.431917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:49.438815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85254b67f7144fdc8ed6d35214935ffd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.530289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85254b67f7144fdc8ed6d35214935ffd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.554368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-94be0db1-d8d6-456f-aade-defd1fadf153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85254b67f7144fdc8ed6d35214935ffd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.569866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 974/1953] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:48 2022] DELETE /identity/v3/users/85254b67f7144fdc8ed6d35214935ffd => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:00:49.610056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcad2cf96cb40c5ae118a542cb940c9', 'request_id': 'req-2596da26-3fa6-43c7-9a12-ed1610524453'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.629963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcad2cf96cb40c5ae118a542cb940c9', 'request_id': 'req-2596da26-3fa6-43c7-9a12-ed1610524453'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.643529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcad2cf96cb40c5ae118a542cb940c9', 'request_id': 'req-2596da26-3fa6-43c7-9a12-ed1610524453'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.659734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] The token cache is being invalidate because project 2dcad2cf96cb40c5ae118a542cb940c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:49.660193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.660913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2596da26-3fa6-43c7-9a12-ed1610524453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:49.666762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 980/1954] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:49 2022] DELETE /identity/v3/projects/2dcad2cf96cb40c5ae118a542cb940c9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:49.668894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.669143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.669631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.708145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:49.712409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:49.842857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.843265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.844390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.853529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 975/1955] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:49.881685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:49.884378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:49.897719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 981/1956] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:49.902700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:49.917166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac62d-6915-4511-afc0-2034f9b18bb2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:49.923555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:49.924852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.925150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.925424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.926124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:49.926432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:49.928084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:49.949821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 976/1957] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:49.954670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:49.971057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373a2e-51d1-41fe-8b91-f8397ed96ffb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:49.977057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:49.977911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:49.978296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:49.978718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:49.979513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:49.981666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.033697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 982/1958] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:49 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:50.038306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.054987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cff8-6323-44ca-8dc3-6bc316212ea1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:50.108116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.114423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:50.220476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:50.252070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:50.253028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.253470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.253990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.254670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:50.257358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.267034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559e816-24b5-4517-8acb-82a2e5b888a0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:50.281340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:50.284866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.285612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.286319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] PATH_INFO: `/v3/projects/40636106cad74730bb067789e9a956a1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.290262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40636106cad74730bb067789e9a956a1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:50.294498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.309989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 977/1959] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:50 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:00:50.310945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.328448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becddb6a-469e-46cc-b488-56acc5f1bec8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:50.340078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:50.340961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.341341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.341730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.342471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:50.344344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.360709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 978/1960] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:50.364411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.379095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dc39-cb9c-4672-b2b7-ee304b8a8803 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:50.389417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40636106cad74730bb067789e9a956a1', 'request_id': 'req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:50.401420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40636106cad74730bb067789e9a956a1', 'request_id': 'req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:50.413125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40636106cad74730bb067789e9a956a1', 'request_id': 'req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:50.424987 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:50.429605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] The token cache is being invalidate because project 40636106cad74730bb067789e9a956a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:50.429957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:50.430780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:50.443372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 983/1961] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:50 2022] DELETE /identity/v3/projects/40636106cad74730bb067789e9a956a1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:50.497948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:50.510599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.511241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.511812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.512934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:50.517226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215b7bb-45de-4e57-bfcb-a985db8a4df3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.538639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 979/1962] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:50.543360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.544962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:50.570343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa9eb-0485-4da9-a43a-2770fe3815c3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:50.571143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:50.572316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.572947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.573328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] PATH_INFO: `/v3/projects/ced09943b1304c64bd0f81a7ccac0cd7/users/ca15f3b8f4784ae69677624e0157eb81/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.600649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced09943b1304c64bd0f81a7ccac0cd7, user_id=ca15f3b8f4784ae69677624e0157eb81, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:50.604210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:50.633515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 984/1963] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:50 2022] PUT /identity/v3/projects/ced09943b1304c64bd0f81a7ccac0cd7/users/ca15f3b8f4784ae69677624e0157eb81/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:50.648626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702d21-3dad-424e-a718-01b07ab3cc1b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:50.649100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702d21-3dad-424e-a718-01b07ab3cc1b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:50.649622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702d21-3dad-424e-a718-01b07ab3cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:50.711264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-81702d21-3dad-424e-a718-01b07ab3cc1b None None] MFA Rules not processed for user `ca15f3b8f4784ae69677624e0157eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:50.713388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-81702d21-3dad-424e-a718-01b07ab3cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:50.891682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 980/1964] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:50.904825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:50.908232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:51.020903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcaaf-ffc1-4d14-97e8-8759ae6dea05 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:51.026415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:51.027495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:51.028608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:51.028608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:51.049208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:51.052374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:51.068128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 985/1965] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:00:52.795345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2adba-c1ee-4082-843e-2e7096b93f61 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:52.799580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2adba-c1ee-4082-843e-2e7096b93f61 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:52.800044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2adba-c1ee-4082-843e-2e7096b93f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:52.847551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6bb2adba-c1ee-4082-843e-2e7096b93f61 None None] MFA Rules not processed for user `ca15f3b8f4784ae69677624e0157eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:52.848770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6bb2adba-c1ee-4082-843e-2e7096b93f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:52.856944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 981/1966] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:55.206075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:55.207747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:55.354018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:55.375681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f9b5-22c2-4c02-922c-bdfc78052a73 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:55.380771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:55.381639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:55.381922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:55.382261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] PATH_INFO: `/v3/users/0dfcbc55c895439c951310dd6aac324c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:55.383503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfcbc55c895439c951310dd6aac324c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:55.385453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:55.455693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfcbc55c895439c951310dd6aac324c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:55.467982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfcbc55c895439c951310dd6aac324c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:55.487349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfcbc55c895439c951310dd6aac324c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:55.502988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfcbc55c895439c951310dd6aac324c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:55.503748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfcbc55c895439c951310dd6aac324c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:55.517663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 986/1967] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:00:55 2022] DELETE /identity/v3/users/0dfcbc55c895439c951310dd6aac324c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:55.522510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:55.523482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:55.523958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:55.545018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:55.546398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:55.662534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 982/1968] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:55.673754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:55.678235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:55.766823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2270ff-eeab-41ab-9ef3-76961ddf27fc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:55.770960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:55.771788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:55.772072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:55.772343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:55.788463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:55.791156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739ef5-dbfd-430e-a3f8-af4381a8b494 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:55.822923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 987/1969] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:00:56.145975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.149155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:56.190415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850304f8-2e64-4be2-b39f-c7a0f3359651 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.195899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.196578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.196861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.197135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] PATH_INFO: `/v3/projects/04ffb095c9264d84802da66527c9d60e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.198345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ffb095c9264d84802da66527c9d60e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.200344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.251818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:56.274082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ffb095c9264d84802da66527c9d60e', 'request_id': 'req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:56.281252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ffb095c9264d84802da66527c9d60e', 'request_id': 'req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:56.287587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ffb095c9264d84802da66527c9d60e', 'request_id': 'req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:56.305016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] The token cache is being invalidate because project 04ffb095c9264d84802da66527c9d60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:00:56.305215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:56.305973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2d1b9ae5-ea70-41a0-9a0f-125acaf5a99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:00:56.307949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 983/1970] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:00:56 2022] DELETE /identity/v3/projects/04ffb095c9264d84802da66527c9d60e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:56.314237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.314820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.315020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.338578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:56.339825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:56.414654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 988/1971] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:56.424295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.424579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.424850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.448187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:56.449433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:56.464126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 984/1972] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:56.465609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.476358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e7049-75b0-4184-bafe-f2ac73eca146 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.481196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.481850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.482247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.482524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.483193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:00:56.484002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.485841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.496176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:56.501600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 989/1973] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:00:56.505089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.514513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5069ef-0fc2-473f-a35c-6fdaa3007951 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.520381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.521017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.521294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.521600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.522240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.524160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.558176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 985/1974] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:56.563521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.573999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c5b5-861b-4aae-9def-fd263bf78d26 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.641750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.642370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.642654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.642928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.643572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.645555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.668437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 990/1975] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:56.673436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.684273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d3f5-7bbd-47d6-8fa9-79774866fb10 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.691292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.691912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.692187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.692452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.693107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.694759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.706500 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 986/1976] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:56.710786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.723025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7765c-de8e-49fb-8d3d-fc8cdfbeb417 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.727789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.728420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.728695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.728968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.729672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.731257 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7ff25-e062-442c-a15f-38288742cb4a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.744101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 991/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:56.748966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:56.759614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543cd3-3b31-4c9f-bbed-da2b3be787ce admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:56.764520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:56.765704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.765988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.766257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] PATH_INFO: `/v3/projects/2f6e4b08b404448584649ffcda844049/users/eb64628a409f4b03aa9ff94ed21b3c44/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.783532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6e4b08b404448584649ffcda844049, user_id=eb64628a409f4b03aa9ff94ed21b3c44, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:56.786249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:56.800885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 987/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:56 2022] PUT /identity/v3/projects/2f6e4b08b404448584649ffcda844049/users/eb64628a409f4b03aa9ff94ed21b3c44/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:56.811302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:56.812167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:56.812435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:56.844474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] MFA Rules not processed for user `eb64628a409f4b03aa9ff94ed21b3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:56.845809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:56.921845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 992/1979] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:56.926369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.009924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e018a9-5e89-4846-8e4e-3cb0a4835939 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.013619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.014252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.014530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.014825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.015502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.017728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.047905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 988/1980] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:00:56 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:57.052508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.068096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ac18-b3b6-487b-a266-102bffb95055 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.130273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.133726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.133726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.133726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.133726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.134198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.151253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:57.161118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 993/1981] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:00:57 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:00:57.166159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.178634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c56d-2501-48bc-8884-a257e7439d08 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.183246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.183858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.184134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.184403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.185060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.186900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.198118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 989/1982] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:00:57.203346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.213871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5945c-898d-4ac2-92dc-dca4042fb7a4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.219524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.220170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.220452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.220728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] PATH_INFO: `/v3/projects/9edce35a50dc4f869a8035c6803dbcdb/users/ca9a530fb74b4c88944699db3c55317f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.237925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edce35a50dc4f869a8035c6803dbcdb, user_id=ca9a530fb74b4c88944699db3c55317f, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.240709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.255978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 994/1983] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:57 2022] PUT /identity/v3/projects/9edce35a50dc4f869a8035c6803dbcdb/users/ca9a530fb74b4c88944699db3c55317f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:57.260034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.271000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cf703-b8fe-4313-b814-5c8869b331b1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.302857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:57.341109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.341757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.342035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.342309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.343657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.346087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88568845-d5d3-4554-9ba7-33e31c8d596e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.356618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 990/1984] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:00:57.361153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.373209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc74163-bcf2-419b-aa43-5db23a498761 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.378191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.378865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.379147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.379427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] PATH_INFO: `/v3/projects/9edce35a50dc4f869a8035c6803dbcdb/users/ca9a530fb74b4c88944699db3c55317f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.381396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edce35a50dc4f869a8035c6803dbcdb, user_id=ca9a530fb74b4c88944699db3c55317f, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.384086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.396364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 995/1985] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:00:57 2022] PUT /identity/v3/projects/9edce35a50dc4f869a8035c6803dbcdb/users/ca9a530fb74b4c88944699db3c55317f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:00:57.407376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.407653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.407942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.436984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] MFA Rules not processed for user `ca9a530fb74b4c88944699db3c55317f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:00:57.438137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:57.516904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 991/1986] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:00:57.528066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:00:57.529807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:00:57.595124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e445-4dd8-436b-b62a-3a6021dc6ceb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:00:57.599199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:00:57.599819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:00:57.600504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:00:57.600504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:00:57.669091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:00:57.670713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426a59f-14e4-4479-ab6c-e339e8c866df service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:00:57.680813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 996/1987] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:00.363786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:00.437776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587184c-eef1-4479-b231-3afbf76fa0ee None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:00.442595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:00.443239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:00.443516 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:00.443789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] PATH_INFO: `/v3/users/eb64628a409f4b03aa9ff94ed21b3c44` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:00.444941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb64628a409f4b03aa9ff94ed21b3c44)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:00.447149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:00.501599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb64628a409f4b03aa9ff94ed21b3c44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:00.515166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:00.520669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb64628a409f4b03aa9ff94ed21b3c44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:00.522113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb64628a409f4b03aa9ff94ed21b3c44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:00.549647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb64628a409f4b03aa9ff94ed21b3c44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:00.557872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb64628a409f4b03aa9ff94ed21b3c44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:00.567855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 992/1988] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:00 2022] DELETE /identity/v3/users/eb64628a409f4b03aa9ff94ed21b3c44 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:00.580184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:00.581403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:00.582277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:00.607471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:00.608977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:00.685091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 997/1989] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:00.695998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:00.698065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:00.767432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed670-4bdd-4bf9-b365-754ffc52089d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:00.771160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:00.771773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:00.772055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:00.772383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:00.791459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:00.792927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:00.806625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 993/1990] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:01.122547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:01.124754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:01.138903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5417d-9a25-4faf-8202-edadcd296e5b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:01.144521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:01.145166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:01.145445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:01.145750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] PATH_INFO: `/v3/projects/2f6e4b08b404448584649ffcda844049` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:01.146917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6e4b08b404448584649ffcda844049)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:01.149765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:01.161162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:01.204542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6e4b08b404448584649ffcda844049', 'request_id': 'req-573ffb71-6839-48d1-9dbf-a7a67372d46e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.213461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6e4b08b404448584649ffcda844049', 'request_id': 'req-573ffb71-6839-48d1-9dbf-a7a67372d46e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.220780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6e4b08b404448584649ffcda844049', 'request_id': 'req-573ffb71-6839-48d1-9dbf-a7a67372d46e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.232120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] The token cache is being invalidate because project 2f6e4b08b404448584649ffcda844049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:01.232397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.233070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.234764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 998/1991] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:01 2022] DELETE /identity/v3/projects/2f6e4b08b404448584649ffcda844049 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:01.238970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:01.249923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40983647-5189-4e69-a10e-ba80fe77f7df service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:01.307964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:01.308601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:01.308882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:01.309158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] PATH_INFO: `/v3/users/ca9a530fb74b4c88944699db3c55317f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:01.310353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9a530fb74b4c88944699db3c55317f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:01.312832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:01.364224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9a530fb74b4c88944699db3c55317f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.373555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9a530fb74b4c88944699db3c55317f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.374811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9a530fb74b4c88944699db3c55317f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.387947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9a530fb74b4c88944699db3c55317f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.390860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:01.397334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-77a64397-36e6-406d-a6f0-8086f3935549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9a530fb74b4c88944699db3c55317f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.405290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 994/1992] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:01 2022] DELETE /identity/v3/users/ca9a530fb74b4c88944699db3c55317f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:01.689036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:01.691802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:01.715992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ffb71-6839-48d1-9dbf-a7a67372d46e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:01.785471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:01.786138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:01.786422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:01.786698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] PATH_INFO: `/v3/projects/9edce35a50dc4f869a8035c6803dbcdb` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:01.788102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edce35a50dc4f869a8035c6803dbcdb)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:01.790117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:01.850165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edce35a50dc4f869a8035c6803dbcdb', 'request_id': 'req-44fe7698-3aa1-40d4-9174-b9ec073b49d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.859595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edce35a50dc4f869a8035c6803dbcdb', 'request_id': 'req-44fe7698-3aa1-40d4-9174-b9ec073b49d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.877548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edce35a50dc4f869a8035c6803dbcdb', 'request_id': 'req-44fe7698-3aa1-40d4-9174-b9ec073b49d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.891111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] The token cache is being invalidate because project 9edce35a50dc4f869a8035c6803dbcdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:01.891312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.892011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-44fe7698-3aa1-40d4-9174-b9ec073b49d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:01.893934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 999/1993] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:01 2022] DELETE /identity/v3/projects/9edce35a50dc4f869a8035c6803dbcdb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:01.899195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:01.899504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:01.899772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:01.921925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:01.923163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:02.007212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 995/1994] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:02.008542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.008827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.009103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.043893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:02.045729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:02.060008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1000/1995] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:02.064801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.076632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a23aba-76ec-4ba9-a0f6-6b8559805171 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.082578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.083321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.083666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.084049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.084785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:02.085090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.086779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.115800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 996/1996] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:01:02.118929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.131121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53e95-4100-41a3-8bc7-5cdde2f8b38c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.139253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.140889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.141247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.141451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.142704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.144204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.173544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:02.186278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1001/1997] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:02.191743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.205180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9debd-d337-4226-9778-7c5e11207b89 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.296918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.297692 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.298046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.298393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.299174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.301280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.335166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 997/1998] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:02.339398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.351824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb743a-d330-41b8-a15e-8a026946cded admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.357704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.358019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.358234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.358378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.359459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.360942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.375993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1002/1999] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:02.379705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.395703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc4f6c-b03c-4070-b7f1-3a1b80f1efc5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.397755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.398701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.398992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.399264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.400000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.401827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fa3a-b60d-4e56-a3a5-e0cd92efffed admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.416728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 998/2000] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:02.422953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.434785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4769-1a1f-4f57-9c87-9b9dca24f398 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.440698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.441432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.441710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.441991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] PATH_INFO: `/v3/projects/b3c78fcd75ff4027a48c58dd095a3ba4/users/0b2b96293b4842b8b93bd53839d382af/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.460709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c78fcd75ff4027a48c58dd095a3ba4, user_id=0b2b96293b4842b8b93bd53839d382af, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.463575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.502341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1003/2001] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:02 2022] PUT /identity/v3/projects/b3c78fcd75ff4027a48c58dd095a3ba4/users/0b2b96293b4842b8b93bd53839d382af/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:02.515170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.515489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.515809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.577766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] MFA Rules not processed for user `0b2b96293b4842b8b93bd53839d382af`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:02.580024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:02.644417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:02.673432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 999/2002] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:02.678356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.766405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a889-365f-46c1-8798-2a67a371c610 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.777016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.777722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.777995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.778263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.779361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.782160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.838240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.840393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1004/2003] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:02.852800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4135-fcb4-4224-9722-f15a22c6e8c7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.918725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.919551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.919937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.920321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.921710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.924580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.948507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1000/2004] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:02 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:02.953348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:02.964435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e5c5-ce37-4a74-8339-71fc204588dd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:02.969717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:02.970429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:02.970709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:02.970980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:02.971659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:02.973719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:02.985420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1005/2005] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:02.989573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.001819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a73af-fe97-422f-998c-23ce3e8463e4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.008914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.009638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.009926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.010402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.011251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.012936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a756a8-303c-4f2f-b8c4-856c4d5d4d1e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.029076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1001/2006] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:03.031372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.042794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9519d5-3fe4-4a3a-b187-404240150fcb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.054372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.055061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.055339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.055614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] PATH_INFO: `/v3/projects/469127561de3491b8da72aa9f41bc7eb/users/62ad5c8b2cb349e29618bace3bb27f0e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.072618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469127561de3491b8da72aa9f41bc7eb, user_id=62ad5c8b2cb349e29618bace3bb27f0e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.075298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.107086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1006/2007] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:03 2022] PUT /identity/v3/projects/469127561de3491b8da72aa9f41bc7eb/users/62ad5c8b2cb349e29618bace3bb27f0e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:03.111120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.111601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.111880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.146439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] MFA Rules not processed for user `62ad5c8b2cb349e29618bace3bb27f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:03.147861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:03.223072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1002/2008] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:03.227618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.321026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8a0b-e71f-4861-be70-203f7a36df15 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.327778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.328506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.328869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.329210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.329963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.331952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.364698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:03.375543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1007/2009] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:03 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:03.380471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.392873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42a44e-0c3e-4f20-b8e8-95a57bcc08a2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.462553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:03.493868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.494693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.495102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.495468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.496548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.501273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.529676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1003/2010] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:03 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:03.536351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.549410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88f8b-89e9-4285-8b21-06c789942957 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.554704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.555344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.555780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.556082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.556757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.558597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.574904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1008/2011] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:03.578928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.594550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1796-dbad-43c6-8a5e-edc47056cf5e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.601146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.601895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.602214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.602532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] PATH_INFO: `/v3/projects/5af735dce2fa4209a269f65e37dd43db/users/8413c326d1e74d8c87067ca0d2c09781/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.623205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af735dce2fa4209a269f65e37dd43db, user_id=8413c326d1e74d8c87067ca0d2c09781, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.626577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.647563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1004/2012] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:03 2022] PUT /identity/v3/projects/5af735dce2fa4209a269f65e37dd43db/users/8413c326d1e74d8c87067ca0d2c09781/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:03.652982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.669377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122215-00b6-4490-85b4-b6ec492614d2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.738130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.738663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.738947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.739224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.739873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.741559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c7e00-3f1c-4616-9c75-399ab88fe7f5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.752699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1009/2013] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:03.756903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.768691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fa3ca-7b37-4af0-8d68-6284460878f8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:03.773931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:03.774659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.775057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.775747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] PATH_INFO: `/v3/projects/5af735dce2fa4209a269f65e37dd43db/users/8413c326d1e74d8c87067ca0d2c09781/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.777478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af735dce2fa4209a269f65e37dd43db, user_id=8413c326d1e74d8c87067ca0d2c09781, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:03.780724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:03.793231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1005/2014] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:03 2022] PUT /identity/v3/projects/5af735dce2fa4209a269f65e37dd43db/users/8413c326d1e74d8c87067ca0d2c09781/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:03.806128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:03.806561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:03.806731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:03.853747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] MFA Rules not processed for user `8413c326d1e74d8c87067ca0d2c09781`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:03.855145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:03.962534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1010/2015] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:03.977345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:03.979501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:04.081009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2f4b9-4505-4413-8e37-5c34d9d5b491 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:04.086106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:04.086883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:04.087238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:04.087523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:04.198274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:04.200436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041ae0d-33cd-4643-a586-9de7c988f78d service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:04.228067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1006/2016] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:06.077413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:06.080174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:06.105197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf68a-1b2b-4c56-8c97-0bd28ae59fca None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:06.114151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:06.114774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:06.115076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:06.115426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:06.219025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:06.221680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d450cd-2aec-420c-8683-faac32f212b2 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:06.236463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1011/2017] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:06.507698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:06.508490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:06.508627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:06.513845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1007/2018] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:01:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:01:06.576534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:06.578093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:06.578663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:06.662389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:06.664645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:06.685334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:06.703350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:06.705411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:06.826532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974be3d-5a48-4870-b4e9-b9f1020303e3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:06.834617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:06.835672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:06.836134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:06.836650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] PATH_INFO: `/v3/users/20d7ffc4385842b6bd380b65c7ca1507` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:06.837954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1012/2019] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:06.838088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d7ffc4385842b6bd380b65c7ca1507)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:06.839986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:06.844023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:06.855696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:06.858071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:06.884311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff19df2-2de7-41bf-8f1e-4ce5178793e6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:06.892628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:06.892898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:06.893225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:06.893593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:06.904263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:06.906540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:06.918698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1013/2020] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:06.930610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d7ffc4385842b6bd380b65c7ca1507'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:06.951346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d7ffc4385842b6bd380b65c7ca1507'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:06.954077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d7ffc4385842b6bd380b65c7ca1507'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:06.974736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d7ffc4385842b6bd380b65c7ca1507'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:06.990744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d7ffc4385842b6bd380b65c7ca1507'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.002466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1008/2021] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:06 2022] DELETE /identity/v3/users/20d7ffc4385842b6bd380b65c7ca1507 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:07.118913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.130342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783386-9f11-48fa-b5cd-f77d1005adc4 service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.201085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.201818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.202971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.202971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.204409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:07.298450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.300003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:07.303028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.308456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dbdf3-9e35-4022-b541-ec192ea3f819 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.336571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1014/2022] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:07.412247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945881-baaf-4789-83ec-498c7924d04a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.419829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.421583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.422701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.423143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] PATH_INFO: `/v3/projects/35c0326864704f418995ef3b7a6269f5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.425713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c0326864704f418995ef3b7a6269f5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.429294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.492443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c0326864704f418995ef3b7a6269f5', 'request_id': 'req-3edf53f4-c04a-45ad-9aaa-f7321414df31'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.500181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c0326864704f418995ef3b7a6269f5', 'request_id': 'req-3edf53f4-c04a-45ad-9aaa-f7321414df31'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.505983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c0326864704f418995ef3b7a6269f5', 'request_id': 'req-3edf53f4-c04a-45ad-9aaa-f7321414df31'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.522146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] The token cache is being invalidate because project 35c0326864704f418995ef3b7a6269f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:07.522881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.523127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3edf53f4-c04a-45ad-9aaa-f7321414df31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:07.524641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1009/2023] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:07 2022] DELETE /identity/v3/projects/35c0326864704f418995ef3b7a6269f5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:07.529772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.530983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.533445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.556884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:07.558328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:07.609840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:07.633053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1015/2024] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:07.642505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.642785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.643059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.664512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:07.665791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:07.675309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1010/2025] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:07.680872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.692116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d3fe0-79f7-4934-b779-4a9537d455c3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.697382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.697866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.698124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.698390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.699050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:07.699437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.700929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.716294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1016/2026] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:01:07.721505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.727199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:07.731310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8240-76db-41a2-8e40-5173c88e3565 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.738415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.739307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.739799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.740291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.741158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.743179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.776804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1011/2027] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:07 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:07.778113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.790290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004baa9-c5ed-438f-815a-ffddfa17b685 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.869890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.870664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.870888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.883955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.883955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.883955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.898483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1017/2028] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:07 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:07.902642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.917164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ff68-215b-4306-ad9f-97798ce61e72 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.922107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.922847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.923131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.923428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.924091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.925732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.937164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1012/2029] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:07.941152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.951451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23082363-e37c-4546-bc96-e4173af08779 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.956883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.957809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.958087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.958356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:07.958999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:07.960617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac040ca-9d37-4fc0-bcda-b44d2c43b99f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:07.972669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1018/2030] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:07.976934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:07.987429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aa86c-12fb-4e7f-9247-a650a5c5ebdf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:07.992435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:07.993113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:07.993392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:07.993936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] PATH_INFO: `/v3/projects/7f4e5eab358b4d20b4db2005a152bd9e/users/5b06158be8fb4655bf219a79bb1e44dd/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.009712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4e5eab358b4d20b4db2005a152bd9e, user_id=5b06158be8fb4655bf219a79bb1e44dd, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.012388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.027335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1013/2031] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:07 2022] PUT /identity/v3/projects/7f4e5eab358b4d20b4db2005a152bd9e/users/5b06158be8fb4655bf219a79bb1e44dd/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:08.039775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.040067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.040348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.071512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] MFA Rules not processed for user `5b06158be8fb4655bf219a79bb1e44dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:08.072750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:08.148195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1019/2032] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:08.152795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.221818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432177-c42f-48ca-bf0a-e558e857cfc9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.226604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.227221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.227497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.227767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.228411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.230503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.260465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1014/2033] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:08 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:08.265682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.277207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9148-085e-41c4-a18b-6ad915b16a0f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.313381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:08.340941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.341587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.341865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.342194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.343091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.345050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.369799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1020/2034] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:08 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:08.370991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.382275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18221-6530-4ff8-a83f-dd70053100bf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.387150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.387787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.388073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.388429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.389113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.391988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.410771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1015/2035] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:08.418742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.438312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3ba42-cf6f-4c55-921a-7777026a2c4f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.447378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.447378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.447378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.447780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] PATH_INFO: `/v3/projects/3f7e6febddd247a9aba23602af1a0b21/users/9c9841be787144a99d299272096fb8b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.473794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7e6febddd247a9aba23602af1a0b21, user_id=9c9841be787144a99d299272096fb8b7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.476491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.495512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1021/2036] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:08 2022] PUT /identity/v3/projects/3f7e6febddd247a9aba23602af1a0b21/users/9c9841be787144a99d299272096fb8b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:08.504304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.515275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49765dd-6ab3-4d3f-a526-a62d4634a74e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.602166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.602818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.603096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.603361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.604013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.605632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77b5f-42e7-45b9-9b33-7724912b8e70 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.620257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1016/2037] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:08.625125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.635794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26f3a-358e-4285-a74f-29fcc992d424 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.641900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.642975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.642975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.643172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] PATH_INFO: `/v3/projects/3f7e6febddd247a9aba23602af1a0b21/users/9c9841be787144a99d299272096fb8b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.645135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7e6febddd247a9aba23602af1a0b21, user_id=9c9841be787144a99d299272096fb8b7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.647789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.663718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1022/2038] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:08 2022] PUT /identity/v3/projects/3f7e6febddd247a9aba23602af1a0b21/users/9c9841be787144a99d299272096fb8b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:08.676957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.677249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.677559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.712242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] MFA Rules not processed for user `9c9841be787144a99d299272096fb8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:08.713580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:08.720284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:08.820459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1017/2039] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:08.843523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:08.847757 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:08.923883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d421-e311-4035-82b6-0ed74ac8eecc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:08.927802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:08.928443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:08.928725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:08.929002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:08.940001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:08.941464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:08.952577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1023/2040] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:09.050399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:09.060983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de635b9-d173-47d7-a53c-146f667fcd0f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:09.066139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:09.066764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:09.067048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:09.067323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:09.136480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:09.137967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb79d34-f12f-43fa-956e-51f13f361455 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:09.147906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1018/2041] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:11.387731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:11.389899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:11.459617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d5fa9-b64a-4d7a-be5e-b69be2484fd0 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:11.469809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:11.470729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:11.471187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:11.472195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] PATH_INFO: `/v3/users/0b2b96293b4842b8b93bd53839d382af` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:11.473434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2b96293b4842b8b93bd53839d382af)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:11.475594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:11.514996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:11.525362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2b96293b4842b8b93bd53839d382af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:11.536351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2b96293b4842b8b93bd53839d382af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:11.551241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2b96293b4842b8b93bd53839d382af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:11.558126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2b96293b4842b8b93bd53839d382af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:11.558860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2b96293b4842b8b93bd53839d382af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:11.565706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1024/2042] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:11 2022] DELETE /identity/v3/users/0b2b96293b4842b8b93bd53839d382af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:11.570204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:11.570689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:11.570779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:11.590675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:11.591881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:11.653105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1019/2043] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:11.663787 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:11.665258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:11.725536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3055-eae5-4fa8-8392-fd7ddf94719d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:11.729341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:11.729985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:11.730439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:11.730723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:11.742187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:11.743629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:11.754741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1025/2044] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:12.079802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:12.081295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:12.114637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec33b-f1a9-4f01-b423-461ddba5de89 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:12.119553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:12.120183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:12.120457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:12.120725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] PATH_INFO: `/v3/projects/b3c78fcd75ff4027a48c58dd095a3ba4` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:12.121887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c78fcd75ff4027a48c58dd095a3ba4)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:12.124529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:12.183527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:12.197551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c78fcd75ff4027a48c58dd095a3ba4', 'request_id': 'req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.204570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c78fcd75ff4027a48c58dd095a3ba4', 'request_id': 'req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.215696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c78fcd75ff4027a48c58dd095a3ba4', 'request_id': 'req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.228685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] The token cache is being invalidate because project b3c78fcd75ff4027a48c58dd095a3ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:12.228995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.229652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.234726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1020/2045] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:12 2022] DELETE /identity/v3/projects/b3c78fcd75ff4027a48c58dd095a3ba4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:12.237158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:12.255164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25195-a472-4323-bda7-03c29b42a3f4 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:12.328141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:12.328868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:12.329216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:12.330010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] PATH_INFO: `/v3/users/62ad5c8b2cb349e29618bace3bb27f0e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:12.331491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ad5c8b2cb349e29618bace3bb27f0e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:12.333588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:12.400150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ad5c8b2cb349e29618bace3bb27f0e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.411617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ad5c8b2cb349e29618bace3bb27f0e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.414417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:12.432855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ad5c8b2cb349e29618bace3bb27f0e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.441954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ad5c8b2cb349e29618bace3bb27f0e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.443429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ad5c8b2cb349e29618bace3bb27f0e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.457466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1026/2046] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:12 2022] DELETE /identity/v3/users/62ad5c8b2cb349e29618bace3bb27f0e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:12.793253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:12.795311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:12.813962 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37cb14-8c86-4ca4-904b-d14e7fea8bd1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:12.897935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:12.898725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:12.899068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:12.899407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] PATH_INFO: `/v3/projects/469127561de3491b8da72aa9f41bc7eb` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:12.901546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469127561de3491b8da72aa9f41bc7eb)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:12.902825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:12.966686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469127561de3491b8da72aa9f41bc7eb', 'request_id': 'req-733e1342-e9a1-4e50-aff0-dc436bc74c55'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.974280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469127561de3491b8da72aa9f41bc7eb', 'request_id': 'req-733e1342-e9a1-4e50-aff0-dc436bc74c55'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.981492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469127561de3491b8da72aa9f41bc7eb', 'request_id': 'req-733e1342-e9a1-4e50-aff0-dc436bc74c55'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.997762 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] The token cache is being invalidate because project 469127561de3491b8da72aa9f41bc7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:12.998078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:12.999689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.002493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1021/2047] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:12 2022] DELETE /identity/v3/projects/469127561de3491b8da72aa9f41bc7eb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:13.006484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:13.008043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:13.022609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c30dc-c62f-45b1-a0ac-8643fdefcdcd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:13.088731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:13.089368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:13.089683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:13.096880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] PATH_INFO: `/v3/users/8413c326d1e74d8c87067ca0d2c09781` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:13.096880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413c326d1e74d8c87067ca0d2c09781)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:13.096880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:13.159199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413c326d1e74d8c87067ca0d2c09781'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.167586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413c326d1e74d8c87067ca0d2c09781'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.181801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413c326d1e74d8c87067ca0d2c09781'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.189277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413c326d1e74d8c87067ca0d2c09781'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.190046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c176cb-cc19-4bb9-81ae-f3e5c6b30239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413c326d1e74d8c87067ca0d2c09781'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.196472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1027/2048] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:13 2022] DELETE /identity/v3/users/8413c326d1e74d8c87067ca0d2c09781 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:13.711609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:13.714020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:13.749781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1342-e9a1-4e50-aff0-dc436bc74c55 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:13.813163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:13.824916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:13.825754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:13.826055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:13.826369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] PATH_INFO: `/v3/projects/5af735dce2fa4209a269f65e37dd43db` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:13.828592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af735dce2fa4209a269f65e37dd43db)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:13.832845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:13.907376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af735dce2fa4209a269f65e37dd43db', 'request_id': 'req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.914888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af735dce2fa4209a269f65e37dd43db', 'request_id': 'req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.922743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af735dce2fa4209a269f65e37dd43db', 'request_id': 'req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.939243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] The token cache is being invalidate because project 5af735dce2fa4209a269f65e37dd43db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:13.939979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.940658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c06dd1f-cd6c-4928-b4d8-976f888cccb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:13.942200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1022/2049] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:13 2022] DELETE /identity/v3/projects/5af735dce2fa4209a269f65e37dd43db => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:13.947403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:13.947913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:13.948006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:13.971420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:13.972663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:14.039037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:14.056122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1028/2050] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:14.065580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.065825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.066134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.096308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:14.096308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:14.114546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1023/2051] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:14.119090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.129677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7ae98-2e50-4118-820f-853e03274e8a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.135110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.135775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.136050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.136316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.137128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:14.137769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.140869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.170300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1029/2052] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:01:14.175666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.185372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b901e1-d986-4a5c-b6d9-ff81d91cec50 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.194621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.195309 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.195598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.195868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.196985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.199245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.235864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1024/2053] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:14 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:14.242317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.256690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b86-1128-46e4-93c7-ed1d37c4a617 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.342180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.343640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.343640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.343877 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.344408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.346976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.375066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1030/2054] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:14 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:14.379440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.391865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97c7be-010b-4450-bda9-81fb51a8e8da admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.397619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.398659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.399088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.399359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.400874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.403022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.421085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1025/2055] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:14.428955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.441080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ef886-1673-464d-87a3-6cf91192b1d1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.446767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.447414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.447695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.447969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.448623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.450290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd24a62-be3d-4788-a223-276e353993a8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.462182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1031/2056] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:14.467705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.479465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683dd6-e245-4458-96b6-830fe97b03aa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.487041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.488084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.488533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.488968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] PATH_INFO: `/v3/projects/9a04ae8c21774220b506c1ca67d07623/users/fdc74946d7724da5867b2e6e527f927f/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.506998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a04ae8c21774220b506c1ca67d07623, user_id=fdc74946d7724da5867b2e6e527f927f, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.509671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.525218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1026/2057] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:14 2022] PUT /identity/v3/projects/9a04ae8c21774220b506c1ca67d07623/users/fdc74946d7724da5867b2e6e527f927f/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:14.531326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9870e8-514d-4b5a-a4d8-ee42f0ff45ca None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.531618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9870e8-514d-4b5a-a4d8-ee42f0ff45ca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.531923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9870e8-514d-4b5a-a4d8-ee42f0ff45ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.553902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2d9870e8-514d-4b5a-a4d8-ee42f0ff45ca None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:14.555136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2d9870e8-514d-4b5a-a4d8-ee42f0ff45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:14.642350 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1032/2058] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:14.652422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:14.654345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:14.742264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5c0f-2922-44c2-97bc-37869bd21fc4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:14.746028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:14.746705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:14.746997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:14.747273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:14.758530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:14.759894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:14.771315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1027/2059] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:16.063967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:16.065818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:16.066292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:16.098815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:16.100355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:16.181313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1033/2060] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:16.244725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:16.246404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:16.294874 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:16.358543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36faf-238a-46fb-a844-92733a79c49d service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:16.365224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:16.365996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:16.366350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:16.366691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:16.376636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:16.379417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c3d0-c9ea-4946-ad08-3185be93cee7 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:16.392209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1028/2061] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:01:16.822089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:16.824440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:16.849945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:16.855903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe05f-0671-4f86-b714-49d817219b62 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:16.869392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:16.870168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:16.870513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:16.871493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] PATH_INFO: `/v3/users/5b06158be8fb4655bf219a79bb1e44dd` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:16.874231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b06158be8fb4655bf219a79bb1e44dd)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:16.876510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:16.943710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b06158be8fb4655bf219a79bb1e44dd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:16.957116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b06158be8fb4655bf219a79bb1e44dd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:16.973141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b06158be8fb4655bf219a79bb1e44dd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:16.982564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b06158be8fb4655bf219a79bb1e44dd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:16.983911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b06158be8fb4655bf219a79bb1e44dd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:16.994366 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1034/2062] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:16 2022] DELETE /identity/v3/users/5b06158be8fb4655bf219a79bb1e44dd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:16.996033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ba81-7c6f-415e-a046-e85b8f1848ed None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:16.996133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ba81-7c6f-415e-a046-e85b8f1848ed None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:16.996411 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ba81-7c6f-415e-a046-e85b8f1848ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:17.038621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a175ba81-7c6f-415e-a046-e85b8f1848ed None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:17.039743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a175ba81-7c6f-415e-a046-e85b8f1848ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:17.167483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1029/2063] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:17.179608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:17.181992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:17.289864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee89cf-b580-4182-8b37-5839c2a86b20 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:17.296685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:17.303159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:17.303447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:17.303708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:17.318439 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:17.321225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:17.334955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1035/2064] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:17.388728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:17.390320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:17.390834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:17.437020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:17.438587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:17.583022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1030/2065] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:17.616620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:17.618539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:17.761815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183de9-b2a3-4f76-8818-91a87e2329c3 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:17.768876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:17.769589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:17.769812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:17.770088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:17.784193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:17.785578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:17.797371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1036/2066] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:01:17.992321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:17.994682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:18.050753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394870b2-19b2-40ad-ba1e-35792ad8281b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:18.066222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:18.067099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:18.067545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:18.068007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] PATH_INFO: `/v3/projects/7f4e5eab358b4d20b4db2005a152bd9e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:18.069436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4e5eab358b4d20b4db2005a152bd9e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:18.072399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:18.172489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4e5eab358b4d20b4db2005a152bd9e', 'request_id': 'req-34d07afe-a1a9-412f-9db7-36ad93ad6931'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.181385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4e5eab358b4d20b4db2005a152bd9e', 'request_id': 'req-34d07afe-a1a9-412f-9db7-36ad93ad6931'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.183068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:18.195550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4e5eab358b4d20b4db2005a152bd9e', 'request_id': 'req-34d07afe-a1a9-412f-9db7-36ad93ad6931'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.229464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] The token cache is being invalidate because project 7f4e5eab358b4d20b4db2005a152bd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:18.229915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.230914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34d07afe-a1a9-412f-9db7-36ad93ad6931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.235057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1031/2067] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:17 2022] DELETE /identity/v3/projects/7f4e5eab358b4d20b4db2005a152bd9e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:18.239372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:18.255497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c37c9-a8c2-4dea-a275-53552123ad78 service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:18.263060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:18.269373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:18.269983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:18.270433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:18.317899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:18.319595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:18.354642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:18.355514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:18.355797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:18.356075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] PATH_INFO: `/v3/users/9c9841be787144a99d299272096fb8b7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:18.358704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9841be787144a99d299272096fb8b7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:18.360698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:18.407784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1032/2068] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:18.416250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:18.418025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:18.441138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9841be787144a99d299272096fb8b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.454547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9841be787144a99d299272096fb8b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.474154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9841be787144a99d299272096fb8b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.489548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9841be787144a99d299272096fb8b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.493704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9841be787144a99d299272096fb8b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:18.506917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1037/2069] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:18 2022] DELETE /identity/v3/users/9c9841be787144a99d299272096fb8b7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:18.534071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485adc-af69-457b-990b-1f0f21f192f8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:18.626167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:18.627679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:18.628101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:18.628678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:18.631598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:18.676956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:18.726430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:18.728625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d88e9-f873-4406-b3b7-79d8bdd741f5 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:18.760739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1033/2070] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:01:18.983133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:18.984740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:19.143382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa880a-7104-4bbf-ad57-126ba07806e9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.160918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.161933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.161933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.162172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] PATH_INFO: `/v3/projects/3f7e6febddd247a9aba23602af1a0b21` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.163731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7e6febddd247a9aba23602af1a0b21)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:19.166270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:19.226483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:19.255773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7e6febddd247a9aba23602af1a0b21', 'request_id': 'req-76808f34-f872-425b-9449-cf5ddfe484c1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:19.271915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7e6febddd247a9aba23602af1a0b21', 'request_id': 'req-76808f34-f872-425b-9449-cf5ddfe484c1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:19.284764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7e6febddd247a9aba23602af1a0b21', 'request_id': 'req-76808f34-f872-425b-9449-cf5ddfe484c1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:19.304024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] The token cache is being invalidate because project 3f7e6febddd247a9aba23602af1a0b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:19.304320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:19.305705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-76808f34-f872-425b-9449-cf5ddfe484c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:19.309201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1038/2071] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:18 2022] DELETE /identity/v3/projects/3f7e6febddd247a9aba23602af1a0b21 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:19.315264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8449-309c-4726-b906-2b772020539c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.315543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8449-309c-4726-b906-2b772020539c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.315817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8449-309c-4726-b906-2b772020539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.340700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6fed8449-309c-4726-b906-2b772020539c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:19.341788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6fed8449-309c-4726-b906-2b772020539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:19.400081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.400356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.400652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.433240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1034/2072] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:19.442284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.442768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.443107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.451077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:19.453238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:19.503301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:19.507839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:19.534696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1035/2073] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:19.539956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:19.564858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24572-20b6-4d8f-a760-c9dacc64a062 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.576359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.577454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.577758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.578146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.578827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:19.580373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1039/2074] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:19.586035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:19.591625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:19.598670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:19.601099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:19.627614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1036/2075] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:01:19.631996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:19.658848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abb12-7524-49a3-b5a5-3cc0829a6080 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.671813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.672585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.673787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.674775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.676078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:19.679059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:19.747801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1037/2076] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:19 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:19.752893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:19.796749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ffd01-bb34-4419-9c52-fdaec3316f22 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.854681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aed8c8-8498-4933-9b03-423b919843a8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.868204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.868887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.869170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.869720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.870379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:19.872324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:19.928081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1038/2077] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:19 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:19.934236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:19.954977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.955605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.955879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.956148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.960674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab92c3-571e-4728-ac45-5d438a5f1a07 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:19.967241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:19.975902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:19.976525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:19.976811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:19.977085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:19.977772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:19.981362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.012751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1039/2078] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:20.013557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.033778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d882b-8c42-4213-9433-449f6eea19e3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.050992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.051611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.051886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.052153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.055908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.058519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.064562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:20.094776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1040/2079] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:20.099779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.099991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.101829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486195f-32c5-4525-a994-d25fafdbbce1 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.115107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1040/2080] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:01:20.128244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19cbe-c2a4-4e84-98ad-8a8957c36532 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.143225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.143932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.144217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.144495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] PATH_INFO: `/v3/projects/b9192c47a4644e0cb04fe2b881df22dc/users/1fcc02730d8946a687ed7643be8eabea/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.165730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9192c47a4644e0cb04fe2b881df22dc, user_id=1fcc02730d8946a687ed7643be8eabea, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.170572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.190150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1041/2081] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:20 2022] PUT /identity/v3/projects/b9192c47a4644e0cb04fe2b881df22dc/users/1fcc02730d8946a687ed7643be8eabea/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:20.203933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af736-6263-4ad8-807a-3899795f966d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.205069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af736-6263-4ad8-807a-3899795f966d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.205509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af736-6263-4ad8-807a-3899795f966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.284918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-798af736-6263-4ad8-807a-3899795f966d None None] MFA Rules not processed for user `1fcc02730d8946a687ed7643be8eabea`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:20.286963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-798af736-6263-4ad8-807a-3899795f966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:20.407733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.408870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1041/2082] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:20.590339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e739-55e5-4ffa-b1a2-7ad408bad1d6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.597882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.598342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.598698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.599036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.599783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.602352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af0477-4471-46b4-9c80-0ba91a4572dc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.654018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1042/2083] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:20 2022] POST /identity/v3/projects => generated 401 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:20.657809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af736-6263-4ad8-807a-3899795f966d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.671513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af736-6263-4ad8-807a-3899795f966d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.757049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.757406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.758032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.773474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.791237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.791237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.791237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.791237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.791237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.804300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] MFA Rules not processed for user `fdc74946d7724da5867b2e6e527f927f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:20.806332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:20.877278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1042/2084] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:20 2022] POST /identity/v3/users => generated 307 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:20.881271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.897512 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d330d9-6db5-47ba-a219-2cdb7460e950 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.908386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.909018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.909302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.909692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.910632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.912242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.929933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1043/2085] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:20.932640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.946337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092cf34-7c5d-4d6c-86d7-ad3404968c40 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:20.952153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:20.952835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:20.953132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:20.953395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] PATH_INFO: `/v3/projects/254488d8e3a341a591c9f555f777e66d/users/8c77097af17f44c285c78de8f0225bb7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:20.967079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:20.971984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1043/2086] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:20.976710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:20.977988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254488d8e3a341a591c9f555f777e66d, user_id=8c77097af17f44c285c78de8f0225bb7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:20.979143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:20.982964 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:20.999267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f36a-6bd0-4199-82ea-c7570db55e90 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.017544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1044/2087] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:20 2022] PUT /identity/v3/projects/254488d8e3a341a591c9f555f777e66d/users/8c77097af17f44c285c78de8f0225bb7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:21.019738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.079202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:21.110697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.111324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.111716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.111947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.112698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.114667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.124885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b835-c925-4e61-a487-8e463e2d9238 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.131453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.132078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.132463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.132739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.133446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.135310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.151729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1044/2088] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:20 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:21.151950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1045/2089] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:21.153770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.155446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.172347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097768-cdd4-4e7d-982c-1662ebcebf2e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.267867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.267867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.267867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.267867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] PATH_INFO: `/v3/projects/254488d8e3a341a591c9f555f777e66d/users/8c77097af17f44c285c78de8f0225bb7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.269180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08ad61-2ef0-4044-a6bd-ec3ebfc52a4f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.269563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254488d8e3a341a591c9f555f777e66d, user_id=8c77097af17f44c285c78de8f0225bb7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.272218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2443a1-58f4-41cf-a9dd-d3b0ca0c2035 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.274449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.275496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.276278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.276567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.277381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.279628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.288357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1046/2090] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:21 2022] PUT /identity/v3/projects/254488d8e3a341a591c9f555f777e66d/users/8c77097af17f44c285c78de8f0225bb7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:21.302717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.303125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.303468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.312170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1045/2091] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:21 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:21.318452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.330850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b78d-1fa2-4f4c-bd61-b9d1ccb697a9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.353573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] MFA Rules not processed for user `8c77097af17f44c285c78de8f0225bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:21.355177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:21.460206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.461227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.461757 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.462537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.464878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.467791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.485832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1046/2092] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:21.489672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.504031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa26b5-0091-4da9-b3c3-ebdab11b019b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.522318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.524036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.524532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.525019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] PATH_INFO: `/v3/projects/bf77ae82da7b468185f3f841d1d242ea/users/8a314f4fab2f44049f04efa027103550/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.551856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf77ae82da7b468185f3f841d1d242ea, user_id=8a314f4fab2f44049f04efa027103550, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.556241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.565806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1047/2093] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:21.585847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.593524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1047/2094] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:21 2022] PUT /identity/v3/projects/bf77ae82da7b468185f3f841d1d242ea/users/8a314f4fab2f44049f04efa027103550/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:21.594498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:21.595047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.630813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:21.645566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:21.677809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4f03-af01-4717-aa02-0702ee9bb9d1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.687134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.687280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.687623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.688167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.688908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.691731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.706048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1048/2095] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:21.710498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:21.726804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b53f81-ca24-462d-beb4-2d21ef56b2dc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.739721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bd351-1c8b-4e96-b0aa-1409c5f0c6df None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:21.745929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.749161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.750441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.752483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] PATH_INFO: `/v3/projects/bf77ae82da7b468185f3f841d1d242ea/users/8a314f4fab2f44049f04efa027103550/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.758688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf77ae82da7b468185f3f841d1d242ea, user_id=8a314f4fab2f44049f04efa027103550, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.769531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.785916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1049/2096] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:21 2022] PUT /identity/v3/projects/bf77ae82da7b468185f3f841d1d242ea/users/8a314f4fab2f44049f04efa027103550/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:21.891027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:21.891027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:21.891027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:21.891425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:21.973279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:21.975822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:21.987833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1048/2097] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:22.114139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:22.214755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e903-c23f-4213-a01f-52f96d78bcda admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:22.221078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:22.221873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:22.223094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:22.223449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:22.331821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:22.333940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55121525-caae-418d-96da-e244f0d4e1b1 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:22.348455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1050/2098] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:22.879474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:22.882502 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:22.902578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92c94-a96e-46a5-aa26-ea1c4edf7c50 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:22.994369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:22.995609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:22.996227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:22.996675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] PATH_INFO: `/v3/users/ca15f3b8f4784ae69677624e0157eb81` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:22.998584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca15f3b8f4784ae69677624e0157eb81)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:23.000971 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:23.024846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:23.081735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca15f3b8f4784ae69677624e0157eb81'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.109641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca15f3b8f4784ae69677624e0157eb81'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.129679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca15f3b8f4784ae69677624e0157eb81'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.137763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca15f3b8f4784ae69677624e0157eb81'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.138539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca15f3b8f4784ae69677624e0157eb81'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.148276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1049/2099] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:22 2022] DELETE /identity/v3/users/ca15f3b8f4784ae69677624e0157eb81 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:23.153164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:23.153675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:23.153675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:23.183197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:23.184675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:23.274981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1051/2100] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:23.283482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:23.284922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:23.379826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2723bf-e13b-41f1-88a9-96f6a1f6400f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:23.385478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:23.386130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:23.386410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:23.386678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:23.413200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:23.415272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:23.440619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1050/2101] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:23.801635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:23.803681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:23.820117 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7585f-d994-4035-87e3-bb3de8877138 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:23.832556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:23.833216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:23.833509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:23.833807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] PATH_INFO: `/v3/projects/ced09943b1304c64bd0f81a7ccac0cd7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:23.834969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced09943b1304c64bd0f81a7ccac0cd7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:23.837113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:23.858179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:23.953859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced09943b1304c64bd0f81a7ccac0cd7', 'request_id': 'req-5864021f-a769-4967-857b-8af7b12b1c62'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:23.987355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced09943b1304c64bd0f81a7ccac0cd7', 'request_id': 'req-5864021f-a769-4967-857b-8af7b12b1c62'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:24.004933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced09943b1304c64bd0f81a7ccac0cd7', 'request_id': 'req-5864021f-a769-4967-857b-8af7b12b1c62'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:24.036545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] The token cache is being invalidate because project ced09943b1304c64bd0f81a7ccac0cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:24.036931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:24.038512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5864021f-a769-4967-857b-8af7b12b1c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:24.044705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1052/2102] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:23 2022] DELETE /identity/v3/projects/ced09943b1304c64bd0f81a7ccac0cd7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:26.937747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:26.939490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:26.954598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a101-6349-4e23-b3a4-88bf0d327543 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:27.037644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:27.038674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.039026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.039377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] PATH_INFO: `/v3/users/1fcc02730d8946a687ed7643be8eabea` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.040590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcc02730d8946a687ed7643be8eabea)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:27.042973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:27.104387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:27.111605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcc02730d8946a687ed7643be8eabea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.124734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcc02730d8946a687ed7643be8eabea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.144836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcc02730d8946a687ed7643be8eabea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.158022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcc02730d8946a687ed7643be8eabea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.158770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1aadb177-cc80-4c9e-ac38-f9d86925ed4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcc02730d8946a687ed7643be8eabea'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.166677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1051/2103] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:26 2022] DELETE /identity/v3/users/1fcc02730d8946a687ed7643be8eabea => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:27.172099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.172999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.173455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.198420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:27.202328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.219764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.220126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.220474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.253590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] MFA Rules not processed for user `8a314f4fab2f44049f04efa027103550`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:27.255432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.277844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1053/2104] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:27.288053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:27.295694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.365111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1052/2105] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:27.374442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27f63f-e684-4f71-afd0-9c4e414171e7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:27.378119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:27.379336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.379465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.379671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.380365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:27.381936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.390993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:27.392444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17601e7-babd-46de-a14a-9099d499b532 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:27.405093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1054/2106] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:01:27.474467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b344e22-a727-470a-9a39-59b72dae2010 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:27.479219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:27.479840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.480097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.480624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.482813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.555170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:27.590148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:27.590421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:27.602970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1053/2107] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:01:27.766108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.766690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.767236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.786888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:27.788586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.802639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:27.804012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.814472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09b68-1f13-4c1a-99a4-08fd3abca88d service glance] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:27.820510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:27.821160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:27.821441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:27.821804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] PATH_INFO: `/v3/projects/b9192c47a4644e0cb04fe2b881df22dc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:27.822892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9192c47a4644e0cb04fe2b881df22dc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:27.824827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:27.856193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:27.883310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9192c47a4644e0cb04fe2b881df22dc', 'request_id': 'req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.884591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1055/2108] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:27.903083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:27.905121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:27.907084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9192c47a4644e0cb04fe2b881df22dc', 'request_id': 'req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.923894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9192c47a4644e0cb04fe2b881df22dc', 'request_id': 'req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.949974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] The token cache is being invalidate because project b9192c47a4644e0cb04fe2b881df22dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:27.950610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.953166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:27.958247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1054/2109] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:27 2022] DELETE /identity/v3/projects/b9192c47a4644e0cb04fe2b881df22dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:27.961860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:27.965305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:28.013254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c22e53-37ed-419d-afe4-79c2aae9d343 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:28.056419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e474-0d2c-41e3-a1a3-ca254bd6469a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:28.062242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:28.063042 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:28.063863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:28.064119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] PATH_INFO: `/v3/users/8c77097af17f44c285c78de8f0225bb7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:28.065755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c77097af17f44c285c78de8f0225bb7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:28.087694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:28.117815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:28.118648 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:28.118801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:28.119077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:28.122039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:28.175455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c77097af17f44c285c78de8f0225bb7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.185209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c77097af17f44c285c78de8f0225bb7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.191406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:28.201431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c77097af17f44c285c78de8f0225bb7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.206354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:28.208120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432c1ba-2e5f-4392-a59c-52656db79c45 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:28.211446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c77097af17f44c285c78de8f0225bb7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.212496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c77097af17f44c285c78de8f0225bb7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.219897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1055/2110] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:27 2022] DELETE /identity/v3/users/8c77097af17f44c285c78de8f0225bb7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:28.225566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1056/2111] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:01:28.744753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:28.746253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:28.850057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57e3a-aff4-4a86-877d-33e60fff4519 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:28.855254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:28.856020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:28.856399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:28.856781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] PATH_INFO: `/v3/projects/254488d8e3a341a591c9f555f777e66d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:28.860315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254488d8e3a341a591c9f555f777e66d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:28.862596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:28.932667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254488d8e3a341a591c9f555f777e66d', 'request_id': 'req-479d1e53-703d-4602-960c-d286f2c9e3c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.945099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254488d8e3a341a591c9f555f777e66d', 'request_id': 'req-479d1e53-703d-4602-960c-d286f2c9e3c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.953618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254488d8e3a341a591c9f555f777e66d', 'request_id': 'req-479d1e53-703d-4602-960c-d286f2c9e3c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.969069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] The token cache is being invalidate because project 254488d8e3a341a591c9f555f777e66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:28.969575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.970349 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-479d1e53-703d-4602-960c-d286f2c9e3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:28.972267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1056/2112] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:28 2022] DELETE /identity/v3/projects/254488d8e3a341a591c9f555f777e66d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:28.976996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949895-07b7-4885-bde8-385260cec843 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:28.977405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949895-07b7-4885-bde8-385260cec843 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:28.977903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949895-07b7-4885-bde8-385260cec843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.003419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7b949895-07b7-4885-bde8-385260cec843 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:29.004876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b949895-07b7-4885-bde8-385260cec843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:29.040705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:29.087654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1057/2113] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:29.094323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.094714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.095093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.121793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:29.123846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:29.135693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1057/2114] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:29.140535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b949895-07b7-4885-bde8-385260cec843 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.153019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b949895-07b7-4885-bde8-385260cec843 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.172701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.178989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.179280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.179558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.180415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:29.180721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.182552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.200280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1058/2115] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:01:29.202640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.217028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e68e1-3802-4310-b383-25aab3a1a63b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.222060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.222686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.223086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.223371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.224013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.226019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.259642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1058/2116] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:29.264454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.278754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6358d-1a43-4b04-86d3-e6985b550ea4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.385663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.386852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.387295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.387736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.393686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.396111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.462674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1059/2117] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:29.464876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.477753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7828-1601-4f58-826b-c9a5a8a80499 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.486470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.487101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.487389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.487648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.488310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.489978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.502329 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1059/2118] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:29.507479 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.520464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fc2ae-4019-42a1-82c4-04c77c871474 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.526073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.526691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.526976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.527252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.530840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.532492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fff30-affa-4e01-99d2-6e0b068a1f25 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.555706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1060/2119] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:29.559706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.584925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe794-92e5-409f-9e09-7cc30911609d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.596475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.597154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.597690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.597798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] PATH_INFO: `/v3/projects/232d8a8ec5194503bf08408669f91136/users/cdceb01fbdfa4f138a5e083e1714c14a/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.615835 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232d8a8ec5194503bf08408669f91136, user_id=cdceb01fbdfa4f138a5e083e1714c14a, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.619038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.633369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1060/2120] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:29 2022] PUT /identity/v3/projects/232d8a8ec5194503bf08408669f91136/users/cdceb01fbdfa4f138a5e083e1714c14a/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:29.644437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.644661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.644928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.683772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] MFA Rules not processed for user `cdceb01fbdfa4f138a5e083e1714c14a`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:29.685012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:29.760659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1061/2121] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:29.766336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.771094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:29.862276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de5b7-9b03-4abf-a506-d97a4f923808 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.870507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:29.871132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:29.871408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:29.871680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:29.872574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:29.875276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:29.914940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1061/2122] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:29.918634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:29.951693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b765-636b-49bd-adb3-4ecc3f55731a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:29.998432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:30.088488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.089140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.089424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.089727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.090381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.098467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.152322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1062/2123] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:29 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:30.153174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:30.166269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9ac4-f723-4728-913b-2efb4c9353b4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:30.178589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.179227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.179498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.179770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.180417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.182049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.195861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1062/2124] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:30.200168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:30.219392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a4618-b5d2-4438-9927-d8c71fb73948 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:30.225691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.226436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.226791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.227136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] PATH_INFO: `/v3/projects/268833e442d1479ea4f059c23fafd304/users/91e9aa8292ba4eff9fbd5ef873b4ef0a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.253742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268833e442d1479ea4f059c23fafd304, user_id=91e9aa8292ba4eff9fbd5ef873b4ef0a, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.256711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.282644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1063/2125] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:30 2022] PUT /identity/v3/projects/268833e442d1479ea4f059c23fafd304/users/91e9aa8292ba4eff9fbd5ef873b4ef0a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:30.286600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:30.303129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f82e-0cb0-4e1d-8ecf-4e2831631ec2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:30.397548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.398652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.399250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.399736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.400627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.402714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1737010-5d06-47d5-b2a4-932f4a131861 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.426399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1063/2126] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:30.430388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:30.444116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d070-78d8-4cef-8020-7f9718deb1d4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:30.449253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.450132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.450524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.450969 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] PATH_INFO: `/v3/projects/268833e442d1479ea4f059c23fafd304/users/91e9aa8292ba4eff9fbd5ef873b4ef0a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.463548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=268833e442d1479ea4f059c23fafd304, user_id=91e9aa8292ba4eff9fbd5ef873b4ef0a, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.467798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.480160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1064/2127] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:30 2022] PUT /identity/v3/projects/268833e442d1479ea4f059c23fafd304/users/91e9aa8292ba4eff9fbd5ef873b4ef0a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:30.492533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.492821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.493125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.539345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] MFA Rules not processed for user `91e9aa8292ba4eff9fbd5ef873b4ef0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:30.540588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:30.632352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:30.641788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1064/2128] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:30.648573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:30.650640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:30.732376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019fdd-6415-47c9-b36b-1c6d9966cc6a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:30.736007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:30.736621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:30.736894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:30.737163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:30.749623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:30.751076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794daebe-5b26-4012-940c-3922afe4df16 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:30.772351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1065/2129] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:31.380233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:31.490743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eb0be-da71-4c10-91f1-aadd4f07a2b6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:31.495591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:31.496923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:31.497287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:31.498272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] PATH_INFO: `/v3/users/cdceb01fbdfa4f138a5e083e1714c14a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:31.499803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdceb01fbdfa4f138a5e083e1714c14a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:31.502199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:31.567428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdceb01fbdfa4f138a5e083e1714c14a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:31.584201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdceb01fbdfa4f138a5e083e1714c14a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:31.600444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdceb01fbdfa4f138a5e083e1714c14a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:31.608570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdceb01fbdfa4f138a5e083e1714c14a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:31.609282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdceb01fbdfa4f138a5e083e1714c14a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:31.617805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1065/2130] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:31 2022] DELETE /identity/v3/users/cdceb01fbdfa4f138a5e083e1714c14a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:31.622102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:31.623194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:31.623343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:31.646830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:31.648574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:31.799330 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1066/2131] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:31.808981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:31.811923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:31.935307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79cfa3-e512-4b63-a679-664db6686567 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:31.940588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:31.941581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:31.942064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:31.942685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:31.958473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:31.960389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:31.988383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1066/2132] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:32.383521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:32.385385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:32.405443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b302-6b3b-46b4-a4bc-1a6c4a49a323 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:32.424256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:32.424787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:32.425066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:32.425335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] PATH_INFO: `/v3/projects/232d8a8ec5194503bf08408669f91136` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:32.429846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] RBAC: Authorizing `identity:delete_project(project_id=232d8a8ec5194503bf08408669f91136)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:32.431777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:32.474735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:32.547711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232d8a8ec5194503bf08408669f91136', 'request_id': 'req-92f38fd4-8d9a-4386-a528-053d31a9324a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.561099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232d8a8ec5194503bf08408669f91136', 'request_id': 'req-92f38fd4-8d9a-4386-a528-053d31a9324a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.574729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232d8a8ec5194503bf08408669f91136', 'request_id': 'req-92f38fd4-8d9a-4386-a528-053d31a9324a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.596491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] The token cache is being invalidate because project 232d8a8ec5194503bf08408669f91136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:32.597041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.598007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.605407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:32.606544 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1067/2133] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:32 2022] DELETE /identity/v3/projects/232d8a8ec5194503bf08408669f91136 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:32.623614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5933c-a22a-4172-a31a-f493004c4442 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:32.655279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:32.716993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:32.718215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:32.718807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:32.719414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] PATH_INFO: `/v3/users/91e9aa8292ba4eff9fbd5ef873b4ef0a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:32.721976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e9aa8292ba4eff9fbd5ef873b4ef0a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:32.724302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:32.791784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e9aa8292ba4eff9fbd5ef873b4ef0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.803299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e9aa8292ba4eff9fbd5ef873b4ef0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.820265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e9aa8292ba4eff9fbd5ef873b4ef0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.828545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e9aa8292ba4eff9fbd5ef873b4ef0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.829331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77dc1818-f20f-4044-8150-2ab993d3564b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e9aa8292ba4eff9fbd5ef873b4ef0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:32.840236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1067/2134] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:32 2022] DELETE /identity/v3/users/91e9aa8292ba4eff9fbd5ef873b4ef0a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:33.212197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:33.213677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:33.231592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f38fd4-8d9a-4386-a528-053d31a9324a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:33.323604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:33.324408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.324749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.325114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] PATH_INFO: `/v3/projects/268833e442d1479ea4f059c23fafd304` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.326918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268833e442d1479ea4f059c23fafd304)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:33.328960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:33.401929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268833e442d1479ea4f059c23fafd304', 'request_id': 'req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:33.422807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268833e442d1479ea4f059c23fafd304', 'request_id': 'req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:33.431540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268833e442d1479ea4f059c23fafd304', 'request_id': 'req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:33.454550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] The token cache is being invalidate because project 268833e442d1479ea4f059c23fafd304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:33.454857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:33.461855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a1bdb906-1a7a-46ff-9cb2-26e7a3252d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:33.467580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1068/2135] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:33 2022] DELETE /identity/v3/projects/268833e442d1479ea4f059c23fafd304 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:33.471475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.471921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.472326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.518111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:33.520491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:33.637839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.638063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.639798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.644292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1068/2136] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:33.666284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:33.668107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:33.677772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1069/2137] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:33.683093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:33.697044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f540c7-1312-4ade-8abc-acd2c4461e10 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:33.707701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:33.708991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.709355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.709760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.710531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:33.711239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:33.714406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:33.731157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1069/2138] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:01:33.736507 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:33.751628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0adf0-b335-4544-bd25-281d6d805570 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:33.760200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:33.760839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.761123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.761422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.762460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:33.766520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:33.808461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1070/2139] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:33 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:33.814090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:33.835871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c64c6-e6dc-4f7e-a95a-5bc823a5bbc6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:33.893535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:33.983312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:33.984748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:33.985178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:33.985656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:33.986472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:33.988951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.029518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1070/2140] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:33 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:01:34.031567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.041647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:34.050534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df37b-912d-4e51-8765-8c70de6b3b6b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.068504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.069229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.069620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.069971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.070705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.072402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.108960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.116194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1071/2141] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:34.123454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4ccd-b2ce-4a93-b858-1b7e2cc3181c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.128389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.129072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.129421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.129836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.130556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.132215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966df25-a1ca-4f38-ba18-2d4d5ef88308 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.144066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1071/2142] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:34.148261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.175269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ba305-bcf3-4bf5-933d-dfc531053bf3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.184325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.184325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.184325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.184325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] PATH_INFO: `/v3/projects/3b1fad3dadc944c28d4595ace860fe79/users/2c4f03f97b25464cbac87db7628e1658/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.214591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1fad3dadc944c28d4595ace860fe79, user_id=2c4f03f97b25464cbac87db7628e1658, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.219205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.247072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1072/2143] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:34 2022] PUT /identity/v3/projects/3b1fad3dadc944c28d4595ace860fe79/users/2c4f03f97b25464cbac87db7628e1658/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:01:34.250809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.251311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.251798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.286781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] MFA Rules not processed for user `2c4f03f97b25464cbac87db7628e1658`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:34.288382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:34.385376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1072/2144] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:34.398275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.400238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:34.481406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b8c-02fb-4079-9c37-76cbc0e52b0b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.488367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.489810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.490314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.490824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.503399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.504855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75179b16-99f6-444c-a6ff-31b25aef6a59 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.518971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1073/2145] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:34.545983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.645552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9508b-5ec3-4210-bb04-a2dfc06b3f8c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.652280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.653214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.653573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.654412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] PATH_INFO: `/v3/users/2c4f03f97b25464cbac87db7628e1658` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.656156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4f03f97b25464cbac87db7628e1658)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.658144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:34.709367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:34.723927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4f03f97b25464cbac87db7628e1658'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:34.736847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4f03f97b25464cbac87db7628e1658'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:34.754966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4f03f97b25464cbac87db7628e1658'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:34.763637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4f03f97b25464cbac87db7628e1658'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:34.764975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4f03f97b25464cbac87db7628e1658'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:34.776206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1073/2146] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:34 2022] DELETE /identity/v3/users/2c4f03f97b25464cbac87db7628e1658 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:34.779850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.781713 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.782165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.807188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:34.808566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:34.884310 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1074/2147] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:34.897313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:34.899186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:34.973606 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b8094-47fb-4303-9f55-50344e34c024 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:34.978704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:34.979325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:34.979604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:34.979873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:34.995917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:34.997360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa73b19-aa43-446e-81f6-33c5cf7e7453 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:35.033506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1074/2148] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:35.471764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:35.473581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:35.496600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e5627-f183-4543-84a9-7f74d3845dbd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:35.520436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:35.521519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:35.522112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:35.522611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] PATH_INFO: `/v3/projects/3b1fad3dadc944c28d4595ace860fe79` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:35.524038 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1fad3dadc944c28d4595ace860fe79)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:35.526181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:35.613741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1fad3dadc944c28d4595ace860fe79', 'request_id': 'req-acc92a2d-a1a5-4c38-b77c-5785da6c5325'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:35.620724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1fad3dadc944c28d4595ace860fe79', 'request_id': 'req-acc92a2d-a1a5-4c38-b77c-5785da6c5325'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:35.628910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1fad3dadc944c28d4595ace860fe79', 'request_id': 'req-acc92a2d-a1a5-4c38-b77c-5785da6c5325'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:35.637188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:35.660770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] The token cache is being invalidate because project 3b1fad3dadc944c28d4595ace860fe79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:35.661115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:35.661765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-acc92a2d-a1a5-4c38-b77c-5785da6c5325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:35.667390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1075/2149] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:35 2022] DELETE /identity/v3/projects/3b1fad3dadc944c28d4595ace860fe79 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:35.668698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:35.669233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:35.669233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:35.692053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:35.693469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:35.811885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1075/2150] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:35.821597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:35.822128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:35.822652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:35.863636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:35.864872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:35.874557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1076/2151] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:35.878876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:35.892815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886668b-778b-4a59-9a09-94570993f5c6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:35.897952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:35.898565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:35.898849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:35.899443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:35.899917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:35.900227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:35.901984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:35.924814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1076/2152] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:01:35.925667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:35.939488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013be572-70e9-412c-b71b-5a34ec3d4a47 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:35.951356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:35.951990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:35.952273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:35.952548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:35.953196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:35.955184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:35.998332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1077/2153] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:35 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:35.999111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:36.013472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5073-78c0-4543-be1a-2a1d3631f419 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:36.084935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:36.117109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:36.117774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.118225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.118509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.119323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:36.121702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:36.153639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1077/2154] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:35 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:36.155683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:36.173100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c390-29bd-4240-b34c-ac2abe7b5dac admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:36.180080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:36.180845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.181349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.181728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.182455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:36.184176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:36.226743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1078/2155] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:36.227952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:36.239747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0db64d-1c79-42a9-9ea7-f4cb0e401a28 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:36.245171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:36.246137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.246493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.246841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.248174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:36.250031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7f40-2aea-4682-99e0-04a42ec8864d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:36.267195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1078/2156] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:36.268476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:36.286475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956515d-5249-47b1-b7a6-6f0487963b0f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:36.294584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:36.296624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.297467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.298000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] PATH_INFO: `/v3/projects/fd311a22b395499b9a06595880342308/users/7805d323702b4f378e76b439d7bbeb71/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.329048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd311a22b395499b9a06595880342308, user_id=7805d323702b4f378e76b439d7bbeb71, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:36.340873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:36.364689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1079/2157] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:36 2022] PUT /identity/v3/projects/fd311a22b395499b9a06595880342308/users/7805d323702b4f378e76b439d7bbeb71/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:36.378315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde2a1-bba5-4d39-8db9-2abcd40b25c2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.381651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde2a1-bba5-4d39-8db9-2abcd40b25c2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.381651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde2a1-bba5-4d39-8db9-2abcd40b25c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.431713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-99cde2a1-bba5-4d39-8db9-2abcd40b25c2 None None] MFA Rules not processed for user `7805d323702b4f378e76b439d7bbeb71`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:36.432901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-99cde2a1-bba5-4d39-8db9-2abcd40b25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:36.521334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1079/2158] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:36.534760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:36.538498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:36.614057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901053d-7053-4c1c-b927-142de48853d8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:36.618396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:36.619078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:36.619427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:36.619711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:36.643159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:36.644899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0315b-b22a-49ee-a1d5-7613430907b7 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:36.668367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1080/2159] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:39.729168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:39.729791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:39.729791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:39.754190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] MFA Rules not processed for user `fdc74946d7724da5867b2e6e527f927f`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:39.755504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:39.839929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1080/2160] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:42.364808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061c54-f96f-4feb-81cc-237db74bd3db None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:42.366641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061c54-f96f-4feb-81cc-237db74bd3db None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:42.367214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad061c54-f96f-4feb-81cc-237db74bd3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:42.393963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ad061c54-f96f-4feb-81cc-237db74bd3db None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:42.396862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ad061c54-f96f-4feb-81cc-237db74bd3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:42.505992 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1081/2161] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:42.507375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:42.510449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:42.650400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:42.692046 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234388af-cba0-49da-aa14-c3e629a37bdb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:42.699534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:42.700108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:42.701304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:42.701610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:42.719771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:42.723141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b05b04-8f7d-4dac-9df4-94095f0624da service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:42.746807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1081/2162] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:01:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:01:43.128667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:43.129710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:43.130277 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:43.167265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] MFA Rules not processed for user `e8a9079515ec45e2b8ed94e848ffcf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:43.171975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:43.276819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:43.312150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1082/2163] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:44.920065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417f73-7b98-4891-80bd-0e8902c873a1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:44.920623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417f73-7b98-4891-80bd-0e8902c873a1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:44.920623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417f73-7b98-4891-80bd-0e8902c873a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:44.945592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6c417f73-7b98-4891-80bd-0e8902c873a1 None None] MFA Rules not processed for user `af3f4441d96c4343b655b13d60eed759`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:44.946864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6c417f73-7b98-4891-80bd-0e8902c873a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:45.069684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1082/2164] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:49.878184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:49.991831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994592-3725-4d5d-9de0-3556cb99594f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:49.997062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:49.998680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:49.999009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:49.999290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] PATH_INFO: `/v3/users/7805d323702b4f378e76b439d7bbeb71` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:50.000534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7805d323702b4f378e76b439d7bbeb71)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:50.002552 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:50.101536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7805d323702b4f378e76b439d7bbeb71'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.116941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7805d323702b4f378e76b439d7bbeb71'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.117735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7805d323702b4f378e76b439d7bbeb71'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.144610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7805d323702b4f378e76b439d7bbeb71'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.164305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7805d323702b4f378e76b439d7bbeb71'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.184857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1083/2165] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:01:49 2022] DELETE /identity/v3/users/7805d323702b4f378e76b439d7bbeb71 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:50.187303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:50.187814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:50.187909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:50.223425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:50.224910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:50.299897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1083/2166] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:50.310509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:50.313141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:50.386985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04914be-5187-4f36-a83e-48cc79847b07 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:50.391550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:50.392168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:50.392450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:50.392725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:50.403313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:50.405241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad411a-40a6-4062-9669-d4970c15f9b1 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:50.417782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1084/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:01:50.853395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:50.854888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:50.868765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f3f30-2b5c-4f4d-9564-0915db4b5e31 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:50.874754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:50.875547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:50.876577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:50.876577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] PATH_INFO: `/v3/projects/fd311a22b395499b9a06595880342308` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:50.877429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd311a22b395499b9a06595880342308)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:50.879953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:50.937776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd311a22b395499b9a06595880342308', 'request_id': 'req-e3bd9ef0-890b-4fe9-bc41-5b6983557358'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.946234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd311a22b395499b9a06595880342308', 'request_id': 'req-e3bd9ef0-890b-4fe9-bc41-5b6983557358'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.953465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd311a22b395499b9a06595880342308', 'request_id': 'req-e3bd9ef0-890b-4fe9-bc41-5b6983557358'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.965137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] The token cache is being invalidate because project fd311a22b395499b9a06595880342308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:01:50.965137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.966419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3bd9ef0-890b-4fe9-bc41-5b6983557358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:01:50.970390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1084/2168] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:01:50 2022] DELETE /identity/v3/projects/fd311a22b395499b9a06595880342308 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:50.973114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:50.973602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:50.973702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:50.988172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:50.995184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:50.997911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:51.073436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1085/2169] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:51.082803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.083332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.083639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.108979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:51.110515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:51.120705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1085/2170] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:01:51.125410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.135490 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b529144-24f2-47be-86c2-27010ea76dd8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.140789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.141409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.141717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.141991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.142649 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:01:51.142950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.144585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.160722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1086/2171] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:01:51.166657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.178066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2871-444b-4418-8306-07ad705bb04d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.183152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.183841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.184195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.185159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.185734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.187693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.194277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:51.229171 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1086/2172] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:01:51 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:51.230566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.241965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5576f-6789-4dfe-941e-bba91970a8fa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.307711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.308627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.308904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.309175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.310665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.312608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.339053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1087/2173] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:01:51 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:01:51.344492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.355774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ca5b0-f46f-4ff3-a3e6-f2ac9d0ac067 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.360946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.361660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.362055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.362389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.363100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.364755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.375585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1087/2174] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:01:51.379679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.391070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1c411-16e3-4bbc-a9ed-f2a816f7d9f2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.395741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.396338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.396622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.396896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.397605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.399203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243dbef-bd82-4c12-9cc5-1c92ce364594 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.410695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1088/2175] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:01:51.415234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.425842 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda530-680e-4ef7-ad1a-21058f130a02 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.430591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.431249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.431530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.431806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] PATH_INFO: `/v3/projects/d3788b9d79f7439ead5b329bb8f27b31/users/010190c7da004941acb2c4a3e9d14c10/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.448128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3788b9d79f7439ead5b329bb8f27b31, user_id=010190c7da004941acb2c4a3e9d14c10, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.451456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.466758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1088/2176] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:01:51 2022] PUT /identity/v3/projects/d3788b9d79f7439ead5b329bb8f27b31/users/010190c7da004941acb2c4a3e9d14c10/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:01:51.477355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373539-9c12-4707-bd27-feac00a87dd1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.477679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373539-9c12-4707-bd27-feac00a87dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.477979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373539-9c12-4707-bd27-feac00a87dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.508407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-00373539-9c12-4707-bd27-feac00a87dd1 None None] MFA Rules not processed for user `010190c7da004941acb2c4a3e9d14c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:01:51.509556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00373539-9c12-4707-bd27-feac00a87dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:51.595904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1089/2177] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:01:51.607664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:01:51.609640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:01:51.754385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0f7d5-5717-43a2-a5e5-c83c9f9fbf76 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:01:51.771092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:01:51.772923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:01:51.776267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:01:51.776267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:01:51.800510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:01:51.803050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:01:51.820018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1089/2178] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:01.591191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:01.640246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:01.640533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:01.640810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:01.663149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:01.664286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:01.752189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1090/2179] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:01.777446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:01.780284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:01.920037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60cd1-9abc-426e-8bd2-b6e67adebae7 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:01.927220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:01.928057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:01.928416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:01.928759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:01.939118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:01.940896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6022e-a2d5-441d-a8a0-282f9b17fb38 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:01.951289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1090/2180] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:02:02.910952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:03.016209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fd7f-70c9-491c-ade1-106f0d6c5071 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:03.024424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:03.025349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:03.025801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:03.026236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] PATH_INFO: `/v3/users/010190c7da004941acb2c4a3e9d14c10` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:03.028201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010190c7da004941acb2c4a3e9d14c10)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:03.030427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:03.114675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010190c7da004941acb2c4a3e9d14c10'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:03.124339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010190c7da004941acb2c4a3e9d14c10'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:03.125854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010190c7da004941acb2c4a3e9d14c10'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:03.144788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010190c7da004941acb2c4a3e9d14c10'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:03.159557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010190c7da004941acb2c4a3e9d14c10'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:03.180439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1091/2181] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:02:02 2022] DELETE /identity/v3/users/010190c7da004941acb2c4a3e9d14c10 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:02:03.184635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:03.185327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:03.185327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:03.225305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:03.227730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:03.293811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:03.328692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1091/2182] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:02:03.334732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:03.342741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:03.397289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:03.452520 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3121-ab97-4476-8604-fc85667e6004 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:03.462548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:03.463816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:03.465922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:03.465922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:03.488317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:03.491121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8ad4-763b-418d-a7da-bf8f9612d993 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:03.512690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1092/2183] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:03.941696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:03.943443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:03.973611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed09d-0e4a-40bd-a197-137ebe90f861 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:03.980796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:03.981861 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:03.982321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:03.982700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] PATH_INFO: `/v3/projects/d3788b9d79f7439ead5b329bb8f27b31` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:03.984553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3788b9d79f7439ead5b329bb8f27b31)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:03.988629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:04.086896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3788b9d79f7439ead5b329bb8f27b31', 'request_id': 'req-bbb7e475-d08e-4d31-8db3-9dc59cf74281'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:04.100654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3788b9d79f7439ead5b329bb8f27b31', 'request_id': 'req-bbb7e475-d08e-4d31-8db3-9dc59cf74281'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:04.109651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3788b9d79f7439ead5b329bb8f27b31', 'request_id': 'req-bbb7e475-d08e-4d31-8db3-9dc59cf74281'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:04.161829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] The token cache is being invalidate because project d3788b9d79f7439ead5b329bb8f27b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:02:04.162970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:04.165514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bbb7e475-d08e-4d31-8db3-9dc59cf74281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:02:04.173900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1092/2184] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:02:03 2022] DELETE /identity/v3/projects/d3788b9d79f7439ead5b329bb8f27b31 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:02:04.181456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.183466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.184236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.257887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:04.259278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:04.360250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1093/2185] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:04.372172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.373639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.373639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.428256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:04.429939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:04.451863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1093/2186] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:04.456007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:04.468778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00506506-5c46-4091-ae58-03b763e0c544 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:04.487495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:04.488476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.488935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.489362 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.490344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:02:04.490805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:04.497078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:04.524823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1094/2187] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:02:04.530022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:04.546278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3687-3d22-4020-8338-6e344ff49f55 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:04.553810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:04.555441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.556351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.556959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.558210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:04.561791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:04.607597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1094/2188] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:02:04 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:02:04.610382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:04.629054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1593-dede-40fb-a715-7e82c22ed4fa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:04.771128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:04.771775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.772625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.773136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.774295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:04.776919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:04.820764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1095/2189] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:02:04 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:02:04.826387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:04.861560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971adec-7783-4b9b-b4ae-864e363f39d0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:04.897304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:04.898086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.898371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.898645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.905161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:04.906931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:04.921571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1095/2190] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:02:04.942475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:04.959320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73d4f-3223-4485-9778-1530adc05a52 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:04.971426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:04.972232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:04.972517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:04.972794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:04.973463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:04.975231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47a59-1906-46cc-9309-f01dea76c289 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:05.003088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1096/2191] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:02:05.005255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:05.019811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5d72-1d9b-456d-ac32-b8085aa0b807 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:05.035044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:05.035733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:05.036016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:05.036297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] PATH_INFO: `/v3/projects/a4c289d2b30e4f5c8a04b7f88d05a2d3/users/c9a6d159060d4a689fba4743d52c4586/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:05.071474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c289d2b30e4f5c8a04b7f88d05a2d3, user_id=c9a6d159060d4a689fba4743d52c4586, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:05.074767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:05.114574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1096/2192] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:02:05 2022] PUT /identity/v3/projects/a4c289d2b30e4f5c8a04b7f88d05a2d3/users/c9a6d159060d4a689fba4743d52c4586/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:02:05.119206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302bf1-e206-4470-a2b0-9cc66a3cb598 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:05.119602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302bf1-e206-4470-a2b0-9cc66a3cb598 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:05.119973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302bf1-e206-4470-a2b0-9cc66a3cb598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:05.149563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-52302bf1-e206-4470-a2b0-9cc66a3cb598 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:05.152343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-52302bf1-e206-4470-a2b0-9cc66a3cb598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:05.221067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:05.288233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1097/2193] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:05.299282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:05.301611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:05.419548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76f38d-5460-40a8-ba1d-a621256a3013 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:05.425242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:05.426041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:05.426432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:05.426803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:05.446771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:05.448478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:05.478734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1097/2194] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:07.149916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71059020-de29-4cbd-9006-acefb7ad2356 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:07.151198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71059020-de29-4cbd-9006-acefb7ad2356 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:07.151817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71059020-de29-4cbd-9006-acefb7ad2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:07.205821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-71059020-de29-4cbd-9006-acefb7ad2356 None None] MFA Rules not processed for user `c9a6d159060d4a689fba4743d52c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:07.207265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-71059020-de29-4cbd-9006-acefb7ad2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:07.310046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1098/2195] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:07.319344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:07.321095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:07.336468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:07.405431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1909e-0952-4b43-ac91-000c0f242a02 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:07.410557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:07.411344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:07.411647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:07.411891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:07.424935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:07.429725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:07.448000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1098/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:02:09.318085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea29-38ce-40ac-8cdd-f8a7f6b9de40 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:09.318976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea29-38ce-40ac-8cdd-f8a7f6b9de40 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:09.319212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beea29-38ce-40ac-8cdd-f8a7f6b9de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:09.352068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-12beea29-38ce-40ac-8cdd-f8a7f6b9de40 None None] MFA Rules not processed for user `c9a6d159060d4a689fba4743d52c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:09.353395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-12beea29-38ce-40ac-8cdd-f8a7f6b9de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:09.362107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1099/2197] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:12.599978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:12.601693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:12.646151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990383b-4701-4aed-a16d-eabe0090c6ec service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:12.657611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:12.658351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:12.660904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:12.661672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:12.667221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:12.909539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:12.910999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160771-7a66-45b1-83c3-af8f1bde5afc service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:12.934066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1099/2198] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:19.341422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=47 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:22.919045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=53 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:24.754966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:24.755511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:24.755511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:24.757002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1100/2199] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:02:24.764668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec4f2-12ff-452c-9557-57870187af10 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:24.765208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec4f2-12ff-452c-9557-57870187af10 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:24.765208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec4f2-12ff-452c-9557-57870187af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:24.807300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4caec4f2-12ff-452c-9557-57870187af10 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:24.808936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4caec4f2-12ff-452c-9557-57870187af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:24.918085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1100/2200] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:24.932196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:24.934143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:25.006685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8272-74fa-4e21-89b5-e3a4dcf749df None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:25.011789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:25.012639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.012927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.013193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.024325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:25.025889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc2a4a-3470-4788-86fc-06125e195999 service glance] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:25.038510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1101/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:25.112314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a55f0-ab2f-48fa-ae93-398d9dcde0b8 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.112634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a55f0-ab2f-48fa-ae93-398d9dcde0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.112909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a55f0-ab2f-48fa-ae93-398d9dcde0b8 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.114279 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1101/2202] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 13:02:25.118994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099ae2-f0d6-439f-8503-473a8e405bb7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.119282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099ae2-f0d6-439f-8503-473a8e405bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.119561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099ae2-f0d6-439f-8503-473a8e405bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.140327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d1099ae2-f0d6-439f-8503-473a8e405bb7 None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:25.141561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d1099ae2-f0d6-439f-8503-473a8e405bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:25.148188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1102/2203] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:25.160607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a55f0-ab2f-48fa-ae93-398d9dcde0b8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:25.172429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a55f0-ab2f-48fa-ae93-398d9dcde0b8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:25.176016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:25.176587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.176862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.177134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.184707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:25.186164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63fa35-ed24-4bc7-a44b-d14552438369 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:25.193911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1102/2204] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:25.285546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b010-39ba-425f-9219-5a14bcad3e10 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.285804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b010-39ba-425f-9219-5a14bcad3e10 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.286072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b010-39ba-425f-9219-5a14bcad3e10 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.287734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1103/2205] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:02:25.293077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a58-ba26-4c39-b38e-70db57aff0a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.293367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a58-ba26-4c39-b38e-70db57aff0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.293684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a58-ba26-4c39-b38e-70db57aff0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.313725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-27473a58-ba26-4c39-b38e-70db57aff0a6 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:25.314923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-27473a58-ba26-4c39-b38e-70db57aff0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:25.326276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1103/2206] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:25.336925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b010-39ba-425f-9219-5a14bcad3e10 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:25.348693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b010-39ba-425f-9219-5a14bcad3e10 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:25.352174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:25.352760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:25.353036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:25.353308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:25.363808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:25.365235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:25.375868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1104/2207] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:29.045599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3163d3-f628-49c4-8b1e-e08de1ca8dba None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:29.046270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3163d3-f628-49c4-8b1e-e08de1ca8dba None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:29.046270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3163d3-f628-49c4-8b1e-e08de1ca8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:29.065535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8b3163d3-f628-49c4-8b1e-e08de1ca8dba None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:29.066747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8b3163d3-f628-49c4-8b1e-e08de1ca8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:29.127788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1104/2208] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:29.139672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:29.141547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:29.232352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a58e-3d3e-4a5d-a15f-9d43003aae33 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:29.237375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:29.238018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:29.238298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:29.238569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:29.248180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:29.249957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:29.258348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1105/2209] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:02:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:02:39.119389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=65 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:39.255078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=67 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:48.797866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d1bd-8bdf-4998-9cc4-98d435934d73 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:48.798844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d1bd-8bdf-4998-9cc4-98d435934d73 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:48.799278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d1bd-8bdf-4998-9cc4-98d435934d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:48.823925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6b68d1bd-8bdf-4998-9cc4-98d435934d73 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:48.825362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6b68d1bd-8bdf-4998-9cc4-98d435934d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:48.833508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1105/2210] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:48.854741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:48.857185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:48.885175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247169-6662-4a27-9e0d-c4adffe9de76 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:48.890712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:48.891313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:48.891591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:48.891886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:48.900774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:48.902598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b9993-753f-4a40-ab0f-4f06d0003320 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:48.913036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1106/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:51.777038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a760-7d63-4761-9e15-15214df06c13 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:51.777476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a760-7d63-4761-9e15-15214df06c13 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:51.777609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a760-7d63-4761-9e15-15214df06c13 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:51.779018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1106/2212] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 31 13:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:02:51.784495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246a6-2341-4f87-94d4-e9c891c49af1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:51.784975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246a6-2341-4f87-94d4-e9c891c49af1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:51.785079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246a6-2341-4f87-94d4-e9c891c49af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:51.805557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-977246a6-2341-4f87-94d4-e9c891c49af1 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:51.806742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-977246a6-2341-4f87-94d4-e9c891c49af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:51.869635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1107/2213] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 31 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:51.877741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a760-7d63-4761-9e15-15214df06c13 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:51.891287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a760-7d63-4761-9e15-15214df06c13 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:51.896251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:51.896849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:51.897130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:51.897407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:51.899205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:51.911873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:51.913453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64afc6e-f2e7-472e-ac1c-4c28c26206bd service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:51.924182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1107/2214] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:02:52.817935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:52.818402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:52.818749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:52.835440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:52.835931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:52.836173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:52.846683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:52.847895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:52.856067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1108/2215] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:52.857249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:52.858692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:52.865957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1108/2216] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:02:52.870280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:52.879908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:52.882926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f15de-bb38-4799-9b98-875a64b1e8d2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:52.888670 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:52.889305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:52.890148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:52.890625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:52.893223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcede8-46f0-4f1e-b9ea-f509bf9830ef None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:52.898412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:52.899012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:52.899132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:52.899480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:52.899758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:52.900601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb77ed-4593-40d3-920c-dca1eeab2024 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:52.909438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:52.911052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:52.914307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1109/2217] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:02:52.920479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1109/2218] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:02:57.111864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163b25-bcb1-47ad-ac07-c0df64156726 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:57.112355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163b25-bcb1-47ad-ac07-c0df64156726 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:57.112462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc163b25-bcb1-47ad-ac07-c0df64156726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:57.131824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bc163b25-bcb1-47ad-ac07-c0df64156726 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:02:57.133006 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bc163b25-bcb1-47ad-ac07-c0df64156726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:57.141331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1110/2219] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:02:57.158406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:02:57.159781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:02:57.176219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1cd06-4887-4211-888d-e5f729d8b5b0 service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:02:57.181643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:02:57.182233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:02:57.182515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:02:57.182780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:02:57.191267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:02:57.192827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:02:57.202189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1110/2220] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:00.174483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f470-3bc3-48f2-8179-75f0fa13eec2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:00.174963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f470-3bc3-48f2-8179-75f0fa13eec2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:00.175056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f470-3bc3-48f2-8179-75f0fa13eec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:00.194338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4874f470-3bc3-48f2-8179-75f0fa13eec2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:00.195518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4874f470-3bc3-48f2-8179-75f0fa13eec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:00.203813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1111/2221] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:03:00.220316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:00.231567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134573b1-7a2b-40e0-b19b-71db1440dc48 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:00.237236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:00.237862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:00.238146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:00.238419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:00.246490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:00.248043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:00.257604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1111/2222] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:03:04.356553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e04bb-223c-45bd-8d14-644e0f58d463 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:04.357053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e04bb-223c-45bd-8d14-644e0f58d463 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:04.357148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e04bb-223c-45bd-8d14-644e0f58d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:04.377968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f16e04bb-223c-45bd-8d14-644e0f58d463 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:04.379186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f16e04bb-223c-45bd-8d14-644e0f58d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:04.387111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1112/2223] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:04.403055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:04.414967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e39dfb-82a3-4c85-a74b-2cdb1ed30501 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:04.420500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:04.421151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:04.422038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:04.422325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:04.431029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:04.432652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:04.443033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1112/2224] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:07.543755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3f50-f6fc-4611-bdb7-c17fa5f4eda2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:07.544359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3f50-f6fc-4611-bdb7-c17fa5f4eda2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:07.544359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3f50-f6fc-4611-bdb7-c17fa5f4eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:07.565729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-053d3f50-f6fc-4611-bdb7-c17fa5f4eda2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:07.566932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-053d3f50-f6fc-4611-bdb7-c17fa5f4eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:07.574988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1113/2225] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:03:07.595039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:07.605945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce44f19-cb6f-4d27-adde-1e8f3fbfaa4c service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:07.611586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:07.612167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:07.612444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:07.612713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:07.620645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:07.622268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182d8f9-b17f-48d6-b874-a595b79d9733 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:07.632348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1113/2226] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:17.559439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=56 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:17.627990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=42 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:26.823105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33dc3-5e90-4e85-abc3-33c0449fe3fb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:26.823610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33dc3-5e90-4e85-abc3-33c0449fe3fb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:26.823919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33dc3-5e90-4e85-abc3-33c0449fe3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:26.845772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f8e33dc3-5e90-4e85-abc3-33c0449fe3fb None None] MFA Rules not processed for user `c9a6d159060d4a689fba4743d52c4586`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:26.847158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f8e33dc3-5e90-4e85-abc3-33c0449fe3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:26.854837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1114/2227] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:03:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:31.249319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800039-7331-4314-a938-e78890bdb97a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:31.249866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800039-7331-4314-a938-e78890bdb97a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:31.249866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21800039-7331-4314-a938-e78890bdb97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:31.270536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-21800039-7331-4314-a938-e78890bdb97a None None] MFA Rules not processed for user `af3f4441d96c4343b655b13d60eed759`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:31.271756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-21800039-7331-4314-a938-e78890bdb97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:31.330320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1114/2228] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:36.838838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:37.239628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:37.239914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:37.240195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:37.266687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] MFA Rules not processed for user `e8a9079515ec45e2b8ed94e848ffcf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:37.268004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:37.326425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1115/2229] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:41.322537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=25 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:47.027290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994dc6-586a-481f-b2da-57387b77f06d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:47.028300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994dc6-586a-481f-b2da-57387b77f06d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:47.028970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994dc6-586a-481f-b2da-57387b77f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:47.055719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6c994dc6-586a-481f-b2da-57387b77f06d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:47.057253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6c994dc6-586a-481f-b2da-57387b77f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:47.067343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1115/2230] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:47.108066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:47.126340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929f1bf-b347-4d77-918b-83f435598e58 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:47.132346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:47.133045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:47.133627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:47.134114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:47.144321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:47.146352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:47.159666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1116/2231] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:52.416379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bf19-63f3-4445-9d41-3c5b2f2fa2eb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:52.416895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bf19-63f3-4445-9d41-3c5b2f2fa2eb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:52.417129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bf19-63f3-4445-9d41-3c5b2f2fa2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:52.441433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4254bf19-63f3-4445-9d41-3c5b2f2fa2eb None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:52.443524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4254bf19-63f3-4445-9d41-3c5b2f2fa2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:52.454298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1116/2232] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:52.471961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:52.484734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7e757-4e8d-4803-b57d-e6a9501ba29c service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:52.490484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:52.491173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:52.491518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:52.491858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:52.503650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:52.506637 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb710-86c7-4f29-9dd1-c76acb14ab49 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:52.536329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1117/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:54.019005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:54.019652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:54.019913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:54.040445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] MFA Rules not processed for user `d2292379507f425aa217920f15aba22d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:54.041730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:54.101289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1117/2234] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:55.492093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ce0e-8bc6-424b-88f6-2623ee77a588 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:55.492590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ce0e-8bc6-424b-88f6-2623ee77a588 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:55.492722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ce0e-8bc6-424b-88f6-2623ee77a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:55.512887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-21b3ce0e-8bc6-424b-88f6-2623ee77a588 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:55.514090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-21b3ce0e-8bc6-424b-88f6-2623ee77a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:55.522483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1118/2235] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:03:55.539529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:55.552070 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b453fc3-e75f-4299-80d7-c29cd9a7f26c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:55.557393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:55.557996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:55.558270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:55.558538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:55.567040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:55.568591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:55.578589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1118/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:03:58.651125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f26b-0dba-4a0f-bedc-db9084059087 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:58.651666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f26b-0dba-4a0f-bedc-db9084059087 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:58.651666 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93f26b-0dba-4a0f-bedc-db9084059087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:58.674180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ca93f26b-0dba-4a0f-bedc-db9084059087 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:03:58.675493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ca93f26b-0dba-4a0f-bedc-db9084059087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:03:58.684420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1119/2237] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:03:58.700158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:03:58.712487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375611d6-eecc-446f-9741-fbdde90159bd service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:03:58.718495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:03:58.719304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:03:58.719756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:03:58.720249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:03:58.732240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:03:58.733866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:03:58.745186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1119/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:04:01.860880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:01.861721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:01.861721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:01.881791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:04:01.882997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:01.891201 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1120/2239] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Aug 31 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:04:01.912880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:01.925577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38347-e116-4bf6-b310-5fe94cf6061f service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:01.931328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:01.931970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:01.932218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:01.932488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:01.943847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:01.945460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:01.957316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1120/2240] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:04:11.876055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=46 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:11.951314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=49 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:33.781932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:33.792341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f38d3-f0db-448b-906d-b04a02b00599 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:33.797373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:33.798047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:33.798334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:33.798607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] PATH_INFO: `/v3/users/c9a6d159060d4a689fba4743d52c4586` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:33.799779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a6d159060d4a689fba4743d52c4586)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:33.801967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:33.868495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a6d159060d4a689fba4743d52c4586'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:33.879497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a6d159060d4a689fba4743d52c4586'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:33.880485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a6d159060d4a689fba4743d52c4586'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:33.901026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a6d159060d4a689fba4743d52c4586'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:33.910140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dbc74555-2587-42ce-baad-3a2db0dd7061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a6d159060d4a689fba4743d52c4586'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:33.921394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1121/2241] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:04:33 2022] DELETE /identity/v3/users/c9a6d159060d4a689fba4743d52c4586 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:04:34.686373 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:34.726449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7edf0-27e8-48fd-a96a-0cef044e09e2 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:34.855759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:34.856772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:34.857338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:34.858113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] PATH_INFO: `/v3/projects/a4c289d2b30e4f5c8a04b7f88d05a2d3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:34.859539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c289d2b30e4f5c8a04b7f88d05a2d3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:34.862899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:34.939756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c289d2b30e4f5c8a04b7f88d05a2d3', 'request_id': 'req-7138215f-aea3-4af0-8b28-043e3662a3ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:34.951799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c289d2b30e4f5c8a04b7f88d05a2d3', 'request_id': 'req-7138215f-aea3-4af0-8b28-043e3662a3ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:34.961260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c289d2b30e4f5c8a04b7f88d05a2d3', 'request_id': 'req-7138215f-aea3-4af0-8b28-043e3662a3ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:34.992845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] The token cache is being invalidate because project a4c289d2b30e4f5c8a04b7f88d05a2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:04:34.993076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:34.993834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7138215f-aea3-4af0-8b28-043e3662a3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:34.995448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1121/2242] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:04:34 2022] DELETE /identity/v3/projects/a4c289d2b30e4f5c8a04b7f88d05a2d3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:04:39.252480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:39.253025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:39.253245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:39.287240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] MFA Rules not processed for user `b0dc5717680e45268974b5912e8c7308`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:04:39.289083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:39.377212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1122/2243] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:04:41.322462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:41.322999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:41.323215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:41.343580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:04:41.344967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:41.405184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1122/2244] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:04:41.456390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:41.457848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:41.535763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fce8b-f87e-4bb6-a1ac-25d395a2a07e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:41.541472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:41.542107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:41.542383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:41.542683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:41.550645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:41.552206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ff9be-4c41-4f9d-bda6-2f59b537e8e3 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:41.561442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1123/2245] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:04:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:04:44.496998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:44.498596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:44.549915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:44.584670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffb0b1-8e9c-43da-b17c-c551b2b81233 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:44.590410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002069-30dd-466c-8958-81f241773793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:44.591433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002069-30dd-466c-8958-81f241773793 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:44.591914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002069-30dd-466c-8958-81f241773793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:44.592157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002069-30dd-466c-8958-81f241773793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:44.594076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-49002069-30dd-466c-8958-81f241773793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:44.688012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002069-30dd-466c-8958-81f241773793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:44.689586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002069-30dd-466c-8958-81f241773793 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:44.707884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1123/2246] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:04:45.489326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:45.490418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:45.490418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:45.491787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1124/2247] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:04:45.522355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:45.522904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:45.523007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:45.544104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] MFA Rules not processed for user `458dde7e70e746ef9a69f0e8afca9602`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:04:45.545335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:45.641359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1124/2248] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:04:45.656115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:45.658805 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:45.691161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a92-f620-48fc-8f8d-b327d2966c3e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:45.701223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:45.701898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:45.702341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:45.702810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:45.709323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:45.716780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:45.718858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:45.735749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1125/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:04:47.671049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:47.688218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf470b51-b50c-41ad-a5fa-8502a556da19 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:47.703397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:47.704483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:47.705169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:47.707221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:47.713306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:47.763810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:47.766394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:47.783755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1125/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:04:51.124156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:51.126160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:51.211654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ae69-ad4b-47b6-a3f6-38c50030c3ad service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:51.219239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:51.219915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:51.220418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:51.220587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] PATH_INFO: `/v3/users/fdc74946d7724da5867b2e6e527f927f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:51.221854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc74946d7724da5867b2e6e527f927f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:51.224708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:51.292031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc74946d7724da5867b2e6e527f927f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.300704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc74946d7724da5867b2e6e527f927f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.301723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc74946d7724da5867b2e6e527f927f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.321598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc74946d7724da5867b2e6e527f927f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.330789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc74946d7724da5867b2e6e527f927f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.341653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1126/2251] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:04:51 2022] DELETE /identity/v3/users/fdc74946d7724da5867b2e6e527f927f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:04:51.573710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:51.586684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4254-fbfa-4232-87f5-5d3b182b3f33 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:51.655910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:51.656540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:51.656841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:51.657120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] PATH_INFO: `/v3/projects/9a04ae8c21774220b506c1ca67d07623` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:51.660588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a04ae8c21774220b506c1ca67d07623)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:51.662618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:51.664211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:51.713889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a04ae8c21774220b506c1ca67d07623', 'request_id': 'req-80c5435f-2148-4532-9bda-780f66647cba'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.722196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a04ae8c21774220b506c1ca67d07623', 'request_id': 'req-80c5435f-2148-4532-9bda-780f66647cba'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.729995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a04ae8c21774220b506c1ca67d07623', 'request_id': 'req-80c5435f-2148-4532-9bda-780f66647cba'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.740719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] The token cache is being invalidate because project 9a04ae8c21774220b506c1ca67d07623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:04:51.741004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.741695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.743229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1126/2252] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:04:51 2022] DELETE /identity/v3/projects/9a04ae8c21774220b506c1ca67d07623 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:04:51.747213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:51.748611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:51.765338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e332c63-6731-4545-845b-32e46c1ba420 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:51.831195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:51.831840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:51.834406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:51.834976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] PATH_INFO: `/v3/users/8a314f4fab2f44049f04efa027103550` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:51.836401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a314f4fab2f44049f04efa027103550)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:51.838660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:51.856919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:51.899070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a314f4fab2f44049f04efa027103550'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.911215 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a314f4fab2f44049f04efa027103550'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.913519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a314f4fab2f44049f04efa027103550'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.928456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a314f4fab2f44049f04efa027103550'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.936929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-693ab320-dcff-499e-9095-2045aacfd5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a314f4fab2f44049f04efa027103550'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:51.944622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1127/2253] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:04:51 2022] DELETE /identity/v3/users/8a314f4fab2f44049f04efa027103550 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:04:52.294227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:52.296623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:52.353245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5435f-2148-4532-9bda-780f66647cba admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:52.444859 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:52.445477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:52.445764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:52.446036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] PATH_INFO: `/v3/projects/bf77ae82da7b468185f3f841d1d242ea` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:52.447185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf77ae82da7b468185f3f841d1d242ea)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:52.449085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:52.498925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf77ae82da7b468185f3f841d1d242ea', 'request_id': 'req-3c50bb44-b514-4f27-822f-98ab1477e48a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:52.507176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf77ae82da7b468185f3f841d1d242ea', 'request_id': 'req-3c50bb44-b514-4f27-822f-98ab1477e48a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:52.514069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf77ae82da7b468185f3f841d1d242ea', 'request_id': 'req-3c50bb44-b514-4f27-822f-98ab1477e48a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:52.527930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] The token cache is being invalidate because project bf77ae82da7b468185f3f841d1d242ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:04:52.528245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:52.528885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:04:52.530411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1127/2254] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:04:52 2022] DELETE /identity/v3/projects/bf77ae82da7b468185f3f841d1d242ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:04:52.778197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:52.778810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:52.778946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:52.801609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] MFA Rules not processed for user `af3f4441d96c4343b655b13d60eed759`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:04:52.803522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:52.859258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1128/2255] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:04:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:04:55.854615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:04:55.858152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:55.910803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:55.987220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bb44-b514-4f27-822f-98ab1477e48a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:04:55.991928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:04:55.992587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:04:55.992847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:04:55.993148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:04:55.995264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:04:56.068659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:04:56.070135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:04:56.080390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1128/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:00.547057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:00.548838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:00.569005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787611f3-7dd6-4bbc-baea-5e969310abf5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:00.579438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:00.579935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:00.580415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:00.581110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] PATH_INFO: `/v3/users/e8a9079515ec45e2b8ed94e848ffcf6e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:00.583316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a9079515ec45e2b8ed94e848ffcf6e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:00.586233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:00.655003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a9079515ec45e2b8ed94e848ffcf6e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:00.664387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a9079515ec45e2b8ed94e848ffcf6e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:00.665267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a9079515ec45e2b8ed94e848ffcf6e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:00.681425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a9079515ec45e2b8ed94e848ffcf6e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:00.693455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7600263-fba2-48d0-a265-7a1ffdab3fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a9079515ec45e2b8ed94e848ffcf6e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:00.706826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1129/2257] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:00 2022] DELETE /identity/v3/users/e8a9079515ec45e2b8ed94e848ffcf6e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:00.962153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:00.996623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c95-9dc9-41fb-8ed4-8af584f81e03 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.090390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.091781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.092094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.093054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] PATH_INFO: `/v3/projects/1ebc839418574d87b98c828b3b1cbf33` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.094853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebc839418574d87b98c828b3b1cbf33)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.104693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.159245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebc839418574d87b98c828b3b1cbf33', 'request_id': 'req-f55a3112-e4ad-4abb-823d-bb05ecd3f286'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:01.170981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebc839418574d87b98c828b3b1cbf33', 'request_id': 'req-f55a3112-e4ad-4abb-823d-bb05ecd3f286'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:01.181133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebc839418574d87b98c828b3b1cbf33', 'request_id': 'req-f55a3112-e4ad-4abb-823d-bb05ecd3f286'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:01.192468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:01.199428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] The token cache is being invalidate because project 1ebc839418574d87b98c828b3b1cbf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:01.200231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:01.201100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f55a3112-e4ad-4abb-823d-bb05ecd3f286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:01.203925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1129/2258] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:00 2022] DELETE /identity/v3/projects/1ebc839418574d87b98c828b3b1cbf33 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:01.216542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.218209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.218843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.247210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:01.249514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:01.257415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:01.346095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1130/2259] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:01.355598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.356031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.356406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.378341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:01.380384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:01.396355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1130/2260] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:01.397607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.408302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74fd36-2e2a-4655-880e-8ab4930af84f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.416172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.416799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.417573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.417910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.418600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:01.419671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.421821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.437123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1131/2261] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:01.447762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.462175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09cd1-45a3-4de1-81a9-63af4052dd14 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.472037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.472781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.473155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.473452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.475285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.477621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.524175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1131/2262] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:01 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:01.525403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.537731 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ed858-eff1-4cdc-9bc8-e2fc8a531a4b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.631176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.632242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.632728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.633149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.634074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.637413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.671566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1132/2263] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:01 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:01.672918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.686794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd7ec-a39b-4679-9f45-d7a918ded740 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.694392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.695134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.695480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.695818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.696544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.698382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.711144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1132/2264] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:01.715300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.728798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c629f-d515-4140-b112-21f58a05bffd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.736295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.737000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.737960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.738300 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.740088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.745732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226c3c-2ee4-4f07-b3d3-3e55f0f52d21 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.760950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1133/2265] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:01.766172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:01.781524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cd2c1-6820-4b79-8425-5eee46185e1c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:01.791219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:01.792667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.792798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.793386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] PATH_INFO: `/v3/projects/0d28e35b097a4418bf1d4512ed0f043c/users/4f3f503c7c6c4b2e9e67a9ffcd07bcbe/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.816489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d28e35b097a4418bf1d4512ed0f043c, user_id=4f3f503c7c6c4b2e9e67a9ffcd07bcbe, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:01.820102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:01.850212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1133/2266] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:01 2022] PUT /identity/v3/projects/0d28e35b097a4418bf1d4512ed0f043c/users/4f3f503c7c6c4b2e9e67a9ffcd07bcbe/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:01.861312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:01.861741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:01.862081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:01.905343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] MFA Rules not processed for user `4f3f503c7c6c4b2e9e67a9ffcd07bcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:01.905343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:02.003171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1134/2267] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:02.014874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:02.017655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:02.142754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78172029-1ddf-4f0d-a6cb-8929a6835350 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:02.151602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:02.152222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:02.152897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:02.153178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:02.166240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:02.168253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:02.180597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1134/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:05:02.477444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:02.484550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:02.487447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:02.491223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:02.520709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717cb5c-cea5-4f78-bede-9ff90ece9ed2 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:02.540534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:02.541172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:02.541985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:02.542455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:02.544865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:02.642114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f1e89-2641-4d90-9ef0-9dbbcd7fb9e8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:02.651657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:02.652378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:02.652662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:02.653036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] PATH_INFO: `/v3/users/4f3f503c7c6c4b2e9e67a9ffcd07bcbe` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:02.654414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3f503c7c6c4b2e9e67a9ffcd07bcbe)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:02.662381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:02.685244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:02.688515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c69f-b708-448e-a8c0-1b38f950c689 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:02.702241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1135/2269] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:05:02.745586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3f503c7c6c4b2e9e67a9ffcd07bcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:02.760747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3f503c7c6c4b2e9e67a9ffcd07bcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:02.762029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3f503c7c6c4b2e9e67a9ffcd07bcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:02.784449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3f503c7c6c4b2e9e67a9ffcd07bcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:02.793613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3f503c7c6c4b2e9e67a9ffcd07bcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:02.807386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1135/2270] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:02 2022] DELETE /identity/v3/users/4f3f503c7c6c4b2e9e67a9ffcd07bcbe => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:02.814558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:02.815173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:02.815605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:02.838891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:02.840241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:02.862991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:02.930680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1136/2271] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:02.940775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:02.942565 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:03.054160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfaac-707c-4772-8c16-d79216690815 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:03.060857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:03.061598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.061880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.062205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.072989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:03.074473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66dd9-c763-4129-83ce-c74f752946da service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:03.085831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1136/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:03.449795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:03.451628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:03.479176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775c8b-3ced-4811-a71a-c8952affd198 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:03.486553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:03.487889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.488372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.488846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] PATH_INFO: `/v3/projects/0d28e35b097a4418bf1d4512ed0f043c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.492562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d28e35b097a4418bf1d4512ed0f043c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:03.496586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:03.595368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d28e35b097a4418bf1d4512ed0f043c', 'request_id': 'req-c9520dab-a156-42dc-b851-0e0c3df35fd4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:03.606953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d28e35b097a4418bf1d4512ed0f043c', 'request_id': 'req-c9520dab-a156-42dc-b851-0e0c3df35fd4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:03.617041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d28e35b097a4418bf1d4512ed0f043c', 'request_id': 'req-c9520dab-a156-42dc-b851-0e0c3df35fd4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:03.635396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] The token cache is being invalidate because project 0d28e35b097a4418bf1d4512ed0f043c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:03.635635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:03.636313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c9520dab-a156-42dc-b851-0e0c3df35fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:03.641511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1137/2273] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:03 2022] DELETE /identity/v3/projects/0d28e35b097a4418bf1d4512ed0f043c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:03.643252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.643707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.643923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.679095 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:03.680353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:03.702662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:03.747635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1137/2274] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:03.757209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.757593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.757935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.777379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:03.778709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:03.787417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1138/2275] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:03.791817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:03.802198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd255eb-89b2-49c8-8814-4d1a6713b35d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:03.807347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:03.807958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.808235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.808546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.809167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:03.809471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:03.811096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:03.824125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1138/2276] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:03.829010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:03.841203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889417-bd19-45a4-b5a8-9fbf5222d0f1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:03.846123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:03.846723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.846999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.847264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.847905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:03.850273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:03.877909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1139/2277] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:03 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:03.883027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:03.893938 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd38d-5a6b-42d0-ac27-047ef26f368f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:03.960512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:03.961119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:03.961403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:03.961704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:03.962347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:03.964281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:03.986691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1139/2278] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:03 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:03.991119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.001598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27557763-ce3b-47f4-b98f-22d3b1edd950 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.007275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.007881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.008225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.008429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.009118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.010693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.022658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1140/2279] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:04.027364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.032954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.035581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:04.039286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63eff-d74b-43a8-96e6-0b77bc89006c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.044686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.045294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.045738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.046011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.046825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.048456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.062786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1140/2280] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:04.068511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.081956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed592b-4f9e-476e-a654-b41c00c04370 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.090502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.091352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.091795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.092103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] PATH_INFO: `/v3/projects/a168933bc58e4d4bad2d1b9623ba77f3/users/a9040cc4ca3847c8922c0708acfffa23/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.115271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a168933bc58e4d4bad2d1b9623ba77f3, user_id=a9040cc4ca3847c8922c0708acfffa23, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.120410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d9f6-4ef4-497a-9f10-057eba27202e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.140371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:04.148755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f2bb-d535-46ff-99a6-182a6b678a64 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.149646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1141/2281] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:04 2022] PUT /identity/v3/projects/a168933bc58e4d4bad2d1b9623ba77f3/users/a9040cc4ca3847c8922c0708acfffa23/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:04.155293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.155293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.155293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.191424 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] MFA Rules not processed for user `a9040cc4ca3847c8922c0708acfffa23`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:04.193366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:04.235345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.236167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.236549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.236916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.239530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:04.288778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:04.290067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1142/2282] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:04.291734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.322900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.324585 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.335406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1141/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:05:04.366323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303de5b-10af-4647-80b7-f595f5468506 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.373974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.374822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.375206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.375543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.376284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.379073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.411058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1143/2284] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:04 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:04.416399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.429131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ab9a-9304-416c-90a9-a144f64c07f9 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.498333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.499075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.499399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.499679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.500366 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.502323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.530164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1142/2285] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:04 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:04.533140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.545296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9faa-f101-424e-baa8-8e322645e41e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.551185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.552743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.553086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.553421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.554240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.555863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.566543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1144/2286] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:04.572320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.583226 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061f39-0a4c-4531-b313-e89c9953301b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.588172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.588825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.589117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.589365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] PATH_INFO: `/v3/projects/55463b5ddecf41748ea67efefac4567a/users/356bba2b43e2472c9418506bc6d4f074/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.607546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55463b5ddecf41748ea67efefac4567a, user_id=356bba2b43e2472c9418506bc6d4f074, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.610931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.625430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1143/2287] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:04 2022] PUT /identity/v3/projects/55463b5ddecf41748ea67efefac4567a/users/356bba2b43e2472c9418506bc6d4f074/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:04.629681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.641457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be000-4ed3-4fac-90fe-420762f40580 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.702572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.703242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.703468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.703740 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.704388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.706143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857723-4e78-4549-86ee-882d8c72c24c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.717013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1145/2288] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:04.721331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.729593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:04.734145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b72a7-7964-4658-a471-11c6f42be47a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.742451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.743126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.743406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.743684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] PATH_INFO: `/v3/projects/55463b5ddecf41748ea67efefac4567a/users/356bba2b43e2472c9418506bc6d4f074/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.745849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=55463b5ddecf41748ea67efefac4567a, user_id=356bba2b43e2472c9418506bc6d4f074, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.748507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:04.759999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1144/2289] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:04 2022] PUT /identity/v3/projects/55463b5ddecf41748ea67efefac4567a/users/356bba2b43e2472c9418506bc6d4f074/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:04.770575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.770793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.771122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.806020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] MFA Rules not processed for user `356bba2b43e2472c9418506bc6d4f074`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:04.807244 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:04.874534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:04.887015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1146/2290] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:04.899073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:04.900947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:04.972204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9210-a2b3-4970-8e3a-2046edad12ff admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:04.976488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:04.977102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:04.977379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:04.977685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:04.987788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:04.989900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e65db-f0de-4adf-aadc-bc0c43488616 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:05.003079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1145/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:05.110126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:05.122208 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524b4f7-532f-4600-8691-f8f00faf7df7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:05.126524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:05.127155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:05.127435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:05.127735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:05.195077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:05.196585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:05.206155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1147/2292] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:14.997054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:15.201851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=31 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:20.579044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:20.579960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:20.579960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:20.601870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:20.603098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:20.669525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1146/2293] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:20.683381 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:20.684921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:20.774905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ad76-0123-40d2-932f-650c5b4204c5 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:20.780152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:20.780780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:20.781071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:20.781371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:20.790913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:20.792703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:20.801557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1148/2294] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:05:30.634845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:30.636365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:30.713295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a84c7-7399-4486-8ee7-3e5bf1ab826d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:30.716954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:30.717610 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:30.717892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:30.718160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:30.719917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:30.731332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:30.733032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:30.743124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1147/2295] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:30.797946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=32 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:34.990833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:35.004110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034a5c3-55c8-465f-abb5-25dd5d2f156c service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:35.008871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:35.009090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:35.009786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:35.009786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:35.011480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:35.022940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:35.024395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:35.035435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1149/2296] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:35.424111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:35.425853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:35.502631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f215-e6d8-492b-8709-d67665cc70f2 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:35.508438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:35.509104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:35.509475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:35.509785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:35.511664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:35.527984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:35.529739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b8ad3-dd68-4faf-8039-49496d884412 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:35.541458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1148/2297] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:36.454946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:36.527611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7cd0-ed53-41c4-b37f-bb0d1b5d4f34 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:36.532639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:36.533352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:36.533675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:36.533950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] PATH_INFO: `/v3/users/a9040cc4ca3847c8922c0708acfffa23` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:36.535494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9040cc4ca3847c8922c0708acfffa23)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:36.537542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:36.590769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9040cc4ca3847c8922c0708acfffa23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:36.600057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9040cc4ca3847c8922c0708acfffa23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:36.600727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9040cc4ca3847c8922c0708acfffa23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:36.616675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9040cc4ca3847c8922c0708acfffa23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:36.625691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9040cc4ca3847c8922c0708acfffa23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:36.633264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1150/2298] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:36 2022] DELETE /identity/v3/users/a9040cc4ca3847c8922c0708acfffa23 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:36.637798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:36.638292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:36.639302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:36.659114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:36.661303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:36.696690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:36.724668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1149/2299] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:36.734605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:36.736141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:36.796789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43c5a-b217-43b3-b3ff-806d0f8a2c58 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:36.801139 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:36.801797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:36.802078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:36.802350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:36.811801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:36.813239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:36.823840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1151/2300] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:05:37.126849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:37.128594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:37.149887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449a654-cd0a-4d09-9e78-662e8ad545fa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:37.157262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:37.158573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:37.158870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:37.159135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] PATH_INFO: `/v3/projects/a168933bc58e4d4bad2d1b9623ba77f3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:37.162333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a168933bc58e4d4bad2d1b9623ba77f3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:37.164473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:37.216866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a168933bc58e4d4bad2d1b9623ba77f3', 'request_id': 'req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.225463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a168933bc58e4d4bad2d1b9623ba77f3', 'request_id': 'req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.231874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a168933bc58e4d4bad2d1b9623ba77f3', 'request_id': 'req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.242185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] The token cache is being invalidate because project a168933bc58e4d4bad2d1b9623ba77f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:37.242469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.243095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2a79c62e-06d5-4464-8bc2-51b0c6f543ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.244570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1150/2301] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:37 2022] DELETE /identity/v3/projects/a168933bc58e4d4bad2d1b9623ba77f3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:37.248533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:37.258344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdbb4-af40-4def-9447-0e8d7a22d460 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:37.262830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:37.324841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:37.325536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:37.325820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:37.326097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] PATH_INFO: `/v3/users/356bba2b43e2472c9418506bc6d4f074` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:37.327288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356bba2b43e2472c9418506bc6d4f074)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:37.329213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:37.367644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:37.367958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:37.368233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:37.380601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356bba2b43e2472c9418506bc6d4f074'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.389385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356bba2b43e2472c9418506bc6d4f074'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.390211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356bba2b43e2472c9418506bc6d4f074'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.393028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:37.395332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:37.405526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356bba2b43e2472c9418506bc6d4f074'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.414924 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356bba2b43e2472c9418506bc6d4f074'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:37.423241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1152/2302] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:37 2022] DELETE /identity/v3/users/356bba2b43e2472c9418506bc6d4f074 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:37.469593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1151/2303] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:37.484518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:37.487216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:37.565183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc620ab-357d-42aa-90ae-b9ac83942db8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:37.570879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:37.571541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:37.571892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:37.572157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:37.610548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:37.663350 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:37.665327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ba936-4e88-4fac-9700-46420a849124 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:37.677398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1153/2304] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:05:37.776160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:37.778672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:37.816140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296f65e-f7d7-4f41-8d8b-32e6d6d134c6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:37.945332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:37.946843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:37.947726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:37.948834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] PATH_INFO: `/v3/projects/55463b5ddecf41748ea67efefac4567a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:37.951006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55463b5ddecf41748ea67efefac4567a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:37.954267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:37.978130 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:38.062234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55463b5ddecf41748ea67efefac4567a', 'request_id': 'req-da93874a-df45-4537-88af-961ac6f415f9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:38.075560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55463b5ddecf41748ea67efefac4567a', 'request_id': 'req-da93874a-df45-4537-88af-961ac6f415f9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:38.086773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55463b5ddecf41748ea67efefac4567a', 'request_id': 'req-da93874a-df45-4537-88af-961ac6f415f9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:38.115141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] The token cache is being invalidate because project 55463b5ddecf41748ea67efefac4567a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:38.115429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:38.116263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-da93874a-df45-4537-88af-961ac6f415f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:38.117815 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1152/2305] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:37 2022] DELETE /identity/v3/projects/55463b5ddecf41748ea67efefac4567a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:38.123863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.124202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.124739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.149858 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:38.151337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:38.240934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1154/2306] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:38.250023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.250335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.250616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.281105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:38.282872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:38.293708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1153/2307] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:38.304995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.324968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2483-21b1-43ba-8590-f7738eacf5f4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.333021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.334196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.334922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.335458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.336458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:38.337072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.339142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.356896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1155/2308] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:38.358935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.371434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68681d-71b5-442f-8dff-917621165b4f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.376434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.376970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.377247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.377555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.378278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.380278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.413455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1154/2309] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:38.418046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.430912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755005d1-ff19-4ff7-8d44-aa418fed683f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.495850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.497054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.497529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.497986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.498919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.501645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.529467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1156/2310] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:38.534758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.547473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d30a-9556-4a0b-a037-c114cfac6afa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.553013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.553885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.554212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.554511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.555210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.557228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.574465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1155/2311] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:38.578760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.590776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b18f9-61aa-4da8-bf95-543c762983eb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.596406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.597696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.598008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.598451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.599107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.600819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f000c-e29c-40f9-a160-59d92a32aab1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.612829 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1157/2312] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:38.617245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.629824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909149c-71a3-4de8-b900-bcad8166795e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.635857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.636700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.637084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.637446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] PATH_INFO: `/v3/projects/01af810b1ed7461283e0d16414e1eab7/users/82cd55992bb84cbfb746a3ef7eeb640a/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.653398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=01af810b1ed7461283e0d16414e1eab7, user_id=82cd55992bb84cbfb746a3ef7eeb640a, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.656153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.669652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1156/2313] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:38 2022] PUT /identity/v3/projects/01af810b1ed7461283e0d16414e1eab7/users/82cd55992bb84cbfb746a3ef7eeb640a/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:38.681744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.682030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.682423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.715668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] MFA Rules not processed for user `82cd55992bb84cbfb746a3ef7eeb640a`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:38.716893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:38.744586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:38.791528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1158/2314] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:38.796857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.833733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.835275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:38.875351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93d63-eb3d-4882-9057-b02cf0776efa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.880368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:38.881001 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:38.881338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:38.881702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:38.882413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:38.884296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:38.923057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbe71-03a7-4601-9afb-7e9e9dc1cbb3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:38.924402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1157/2315] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:38.929796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:38.986116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:39.028748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.029372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.029682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.029957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.031910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:39.054881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88dbf-1327-4bf1-a5db-b323f984470b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.096129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.104981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.105369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.105582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.106221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.108199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.123681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.125399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.133137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:39.142418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1159/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:39.153952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1158/2317] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:38 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:39.160963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:39.180148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5af-7480-4905-817e-06ef1be4121e service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.197991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.199434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.200001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.200771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.202695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.205791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.220814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1160/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:39.225596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:39.240545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa51fc-da29-415e-8966-f2e768d964a5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.255789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.256807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.257552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.258177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] PATH_INFO: `/v3/projects/69867abce9194614a2eb67de62c437c1/users/d0c114bf58ed4e5ca86c6098baa9bd74/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.279451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69867abce9194614a2eb67de62c437c1, user_id=d0c114bf58ed4e5ca86c6098baa9bd74, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.282650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.323399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1159/2319] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:39 2022] PUT /identity/v3/projects/69867abce9194614a2eb67de62c437c1/users/d0c114bf58ed4e5ca86c6098baa9bd74/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:39.327185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:39.346726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ab38-ee64-40ac-b012-bd3fcf709a08 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.442836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.443711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.443999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.444262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.444915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.446582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824236e-213d-4a0d-96e5-8ef426075628 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.458807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1161/2320] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:39.462969 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:39.488067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b3227-7210-42ef-9ba2-43b591167e7e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.493147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.493840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.494120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.494443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] PATH_INFO: `/v3/projects/69867abce9194614a2eb67de62c437c1/users/d0c114bf58ed4e5ca86c6098baa9bd74/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.496480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69867abce9194614a2eb67de62c437c1, user_id=d0c114bf58ed4e5ca86c6098baa9bd74, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.499432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.521524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1160/2321] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:39 2022] PUT /identity/v3/projects/69867abce9194614a2eb67de62c437c1/users/d0c114bf58ed4e5ca86c6098baa9bd74/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:39.525582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.526508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.526963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.575505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] MFA Rules not processed for user `d0c114bf58ed4e5ca86c6098baa9bd74`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:39.576729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:39.681141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1162/2322] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:39.694917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:39.696655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:39.762655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb492aa-24c7-4306-89d7-bafeb9c2ead5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:39.766987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:39.767684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:39.767967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:39.768452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:39.780236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:39.781694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11717eb-5b59-418e-8941-d2f6967bd63f service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:39.793880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1161/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:41.507026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:41.601235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf5ab9-9c24-4651-a20c-a1191e44aaaa None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:41.610817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:41.611478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:41.611767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:41.612054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] PATH_INFO: `/v3/users/82cd55992bb84cbfb746a3ef7eeb640a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:41.613470 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cd55992bb84cbfb746a3ef7eeb640a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:41.617603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:41.650758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:41.698274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cd55992bb84cbfb746a3ef7eeb640a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:41.709980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cd55992bb84cbfb746a3ef7eeb640a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:41.710741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cd55992bb84cbfb746a3ef7eeb640a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:41.734409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cd55992bb84cbfb746a3ef7eeb640a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:41.750157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cd55992bb84cbfb746a3ef7eeb640a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:41.761451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1163/2324] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:41 2022] DELETE /identity/v3/users/82cd55992bb84cbfb746a3ef7eeb640a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:41.762906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:41.763390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:41.763480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:41.784176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:41.785912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:41.852025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1162/2325] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:41.862056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:41.864085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:41.930206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16024b-24bb-4d70-bcaf-557a710f40f0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:41.934495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:41.935438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:41.935812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:41.936182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:41.947169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:41.948712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:41.962830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1164/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:42.286528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:42.287961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:42.300447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2039109-d17c-48fe-bc95-2bd1d8335291 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:42.305211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:42.305870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:42.306145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:42.306416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] PATH_INFO: `/v3/projects/01af810b1ed7461283e0d16414e1eab7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:42.307545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01af810b1ed7461283e0d16414e1eab7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:42.309441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:42.319038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:42.364690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01af810b1ed7461283e0d16414e1eab7', 'request_id': 'req-d0c1ed61-0bac-4273-b6f7-d244b6406338'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.372472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01af810b1ed7461283e0d16414e1eab7', 'request_id': 'req-d0c1ed61-0bac-4273-b6f7-d244b6406338'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.386457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01af810b1ed7461283e0d16414e1eab7', 'request_id': 'req-d0c1ed61-0bac-4273-b6f7-d244b6406338'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.399984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] The token cache is being invalidate because project 01af810b1ed7461283e0d16414e1eab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:42.400280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.400936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.402721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1163/2327] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:42 2022] DELETE /identity/v3/projects/01af810b1ed7461283e0d16414e1eab7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:42.406528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:42.420033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2581da8-5fce-49d8-913d-88c51085b8c9 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:42.482994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:42.483615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:42.483893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:42.484164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] PATH_INFO: `/v3/users/d0c114bf58ed4e5ca86c6098baa9bd74` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:42.485265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c114bf58ed4e5ca86c6098baa9bd74)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:42.487799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:42.529594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:42.540994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c114bf58ed4e5ca86c6098baa9bd74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.550693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c114bf58ed4e5ca86c6098baa9bd74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.551621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c114bf58ed4e5ca86c6098baa9bd74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.570110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c114bf58ed4e5ca86c6098baa9bd74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.578868 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2362ba33-259f-430e-98b1-5e6b81b98583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c114bf58ed4e5ca86c6098baa9bd74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:42.587255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1165/2328] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:42 2022] DELETE /identity/v3/users/d0c114bf58ed4e5ca86c6098baa9bd74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:42.929973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:42.931978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:42.963601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ed61-0bac-4273-b6f7-d244b6406338 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.048122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.048780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.049398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.050500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] PATH_INFO: `/v3/projects/69867abce9194614a2eb67de62c437c1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.052249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69867abce9194614a2eb67de62c437c1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.055495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.112688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69867abce9194614a2eb67de62c437c1', 'request_id': 'req-0373c48c-5135-4307-a6f6-4272ecd01b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:43.126889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69867abce9194614a2eb67de62c437c1', 'request_id': 'req-0373c48c-5135-4307-a6f6-4272ecd01b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:43.137786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69867abce9194614a2eb67de62c437c1', 'request_id': 'req-0373c48c-5135-4307-a6f6-4272ecd01b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:43.151206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] The token cache is being invalidate because project 69867abce9194614a2eb67de62c437c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:43.151646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:43.152298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0373c48c-5135-4307-a6f6-4272ecd01b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:43.154123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1164/2329] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:42 2022] DELETE /identity/v3/projects/69867abce9194614a2eb67de62c437c1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:43.159312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.160370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.160370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.181708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:43.182986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:43.251925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1166/2330] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:43.254527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.255023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.255305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.278979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:43.280224 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:43.292622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1165/2331] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:43.294171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.305603 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa328-5e2a-459e-a05e-ee48f4eda64e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.310489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.311097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.311374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.311644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.312294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:43.312595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.314249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.327270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1167/2332] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:43.332100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.342375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685881e-eee1-4de7-b58b-589aa339215d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.348456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.349368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.349682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.349963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.350639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.352601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.379885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:43.391222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1166/2333] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:43.395926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.407583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd45a-0cbd-42e4-bb85-1c1e057a7801 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.466564 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.467163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.467436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.467703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.468332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.470308 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.499569 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1168/2334] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:43.506051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.519468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12d911-4fa7-4b08-990d-2b660606126b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.525303 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.526028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.526813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.527225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.527962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.529768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.545951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1167/2335] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:43.548718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.559605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285424-abd7-4919-b9b9-d2d8198c16bf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.564099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.564689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.564964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.565264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.566102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.567689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b274f-dce9-4ad8-b761-86b1779199b5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.578365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1169/2336] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:43.584505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.595668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ff68-643b-401a-8d35-70ee7386ac27 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.601308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.602047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.602323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.602594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] PATH_INFO: `/v3/projects/176ad27cd14c4bfa9e023ebcb0e34fbd/users/bda525afd375414d9c59528768b31b0b/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.619935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] RBAC: Authorizing `identity:create_grant(project_id=176ad27cd14c4bfa9e023ebcb0e34fbd, user_id=bda525afd375414d9c59528768b31b0b, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.622857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.639142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1168/2337] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:43 2022] PUT /identity/v3/projects/176ad27cd14c4bfa9e023ebcb0e34fbd/users/bda525afd375414d9c59528768b31b0b/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:43.650721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.651004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.651338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.680980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] MFA Rules not processed for user `bda525afd375414d9c59528768b31b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:43.682250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:43.687170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:43.775777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1170/2338] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:43.780340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.857193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9d2b-0651-4029-9756-8c4a76cf604a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:43.861934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:43.863064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:43.863341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:43.863617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:43.864269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:43.866202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:43.893090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1169/2339] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:43.897822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:43.908528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796d75-d007-4a4e-91e0-d0beda949c27 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.027252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.028027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.029365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.029789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.030881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.034851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.068247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1171/2340] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:43 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:44.074315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.100998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d9645-e46d-4d75-a058-7a37652cd5db admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.114928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.117786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.118604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.119368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.122632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.128799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.164372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1170/2341] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:44.166704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.180090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1236-9bf4-41c3-97fc-874dfc106277 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.185281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.186111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.186485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.186834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] PATH_INFO: `/v3/projects/da51550b119d44fb8d80faadf9026bb0/users/6b4b59e073284d819a5a14083dd7a77a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.204984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da51550b119d44fb8d80faadf9026bb0, user_id=6b4b59e073284d819a5a14083dd7a77a, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.208444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.234610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1172/2342] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:44 2022] PUT /identity/v3/projects/da51550b119d44fb8d80faadf9026bb0/users/6b4b59e073284d819a5a14083dd7a77a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:44.238580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.256882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a655-4721-477b-a1cb-5fdb90d0a23f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.325613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.326529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.326995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.327611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.328538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.331153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925624-dc2a-48d6-8bc9-94ccb5a870b7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.355467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1171/2343] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:44.356820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.369301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb636f-8cb4-4454-a5ed-0a9526196dc5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.374543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.375413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.375847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.376288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] PATH_INFO: `/v3/projects/da51550b119d44fb8d80faadf9026bb0/users/6b4b59e073284d819a5a14083dd7a77a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.378644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da51550b119d44fb8d80faadf9026bb0, user_id=6b4b59e073284d819a5a14083dd7a77a, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.381518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.403438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1173/2344] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:44 2022] PUT /identity/v3/projects/da51550b119d44fb8d80faadf9026bb0/users/6b4b59e073284d819a5a14083dd7a77a/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:44.415097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.415097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.415699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.454198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] MFA Rules not processed for user `6b4b59e073284d819a5a14083dd7a77a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:44.457629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:44.488052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:44.544218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1172/2345] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:44.558090 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.561040 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:44.639593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42cd27-bf8f-4106-8c73-de46d60839b8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.643461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.644077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.644364 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.644730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.654248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.655756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d8fcd-06a4-4dd6-8806-8e74bcaf3a9a service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.666598 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1174/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:44.748184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:44.841524 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c087-e924-4224-84cc-3b2e403839e8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:44.846578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:44.847588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.848075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.848422 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] PATH_INFO: `/v3/users/bda525afd375414d9c59528768b31b0b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.849992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda525afd375414d9c59528768b31b0b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:44.852322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:44.904643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda525afd375414d9c59528768b31b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:44.914555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda525afd375414d9c59528768b31b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:44.928543 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda525afd375414d9c59528768b31b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:44.935630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda525afd375414d9c59528768b31b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:44.936352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda525afd375414d9c59528768b31b0b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:44.946878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1173/2347] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:44 2022] DELETE /identity/v3/users/bda525afd375414d9c59528768b31b0b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:44.951728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:44.952009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:44.952281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:44.960755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:44.975946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:44.977421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:45.051161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1175/2348] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:45.063019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:45.064584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:45.125611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:45.155991 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d13-67aa-4e3a-9997-cffe0b0d774c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:45.160670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:45.161376 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:45.161693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:45.161968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:45.173337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:45.176085 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:45.192142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1174/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:45.547332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:45.550045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:45.565474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30cf2c-7e4e-40d3-bcf1-4e33e823c694 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:45.590794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:45.593267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:45.593925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:45.594681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] PATH_INFO: `/v3/projects/176ad27cd14c4bfa9e023ebcb0e34fbd` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:45.598018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176ad27cd14c4bfa9e023ebcb0e34fbd)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:45.600333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:45.671454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176ad27cd14c4bfa9e023ebcb0e34fbd', 'request_id': 'req-b7c4c557-3c60-4ad2-9479-056a0762a223'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.683051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176ad27cd14c4bfa9e023ebcb0e34fbd', 'request_id': 'req-b7c4c557-3c60-4ad2-9479-056a0762a223'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.689108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176ad27cd14c4bfa9e023ebcb0e34fbd', 'request_id': 'req-b7c4c557-3c60-4ad2-9479-056a0762a223'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.707647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] The token cache is being invalidate because project 176ad27cd14c4bfa9e023ebcb0e34fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:45.707945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.709041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.710194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1176/2350] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:45 2022] DELETE /identity/v3/projects/176ad27cd14c4bfa9e023ebcb0e34fbd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:45.715556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:45.726629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9e0e-8efc-4059-895c-acc755fc410e service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:45.809611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:45.810256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:45.810533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:45.810809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] PATH_INFO: `/v3/users/6b4b59e073284d819a5a14083dd7a77a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:45.812175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4b59e073284d819a5a14083dd7a77a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:45.814312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:45.875118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4b59e073284d819a5a14083dd7a77a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.882830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4b59e073284d819a5a14083dd7a77a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.899230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4b59e073284d819a5a14083dd7a77a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.912993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4b59e073284d819a5a14083dd7a77a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.914361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ae9f39ab-6b36-41f5-8bed-49ddd2c96cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4b59e073284d819a5a14083dd7a77a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:45.927055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1175/2351] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:45 2022] DELETE /identity/v3/users/6b4b59e073284d819a5a14083dd7a77a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:46.291894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:46.294415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:46.322372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4c557-3c60-4ad2-9479-056a0762a223 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:46.401010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:46.401750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:46.402047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:46.402305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] PATH_INFO: `/v3/projects/da51550b119d44fb8d80faadf9026bb0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:46.403592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da51550b119d44fb8d80faadf9026bb0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:46.406342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:46.455663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:46.494735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da51550b119d44fb8d80faadf9026bb0', 'request_id': 'req-9230bb8f-47c6-4fc4-a3a2-71c29603868e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:46.509295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da51550b119d44fb8d80faadf9026bb0', 'request_id': 'req-9230bb8f-47c6-4fc4-a3a2-71c29603868e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:46.518128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da51550b119d44fb8d80faadf9026bb0', 'request_id': 'req-9230bb8f-47c6-4fc4-a3a2-71c29603868e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:46.547005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] The token cache is being invalidate because project da51550b119d44fb8d80faadf9026bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:46.547242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:46.547920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9230bb8f-47c6-4fc4-a3a2-71c29603868e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:46.549455 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1177/2352] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:46 2022] DELETE /identity/v3/projects/da51550b119d44fb8d80faadf9026bb0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:46.555079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:46.555577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:46.555788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:46.604400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:46.606908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:46.702459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:46.720152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1176/2353] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:46.741703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:46.741703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:46.741703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:46.768097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:46.770258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:46.790602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1178/2354] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:46.797411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:46.808562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad12271-504a-4ba4-95dd-ed8ad8737833 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:46.814105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:46.814732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:46.815004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:46.816195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:46.816546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:46.816825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:46.818686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:46.845274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1177/2355] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:46.847451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:46.876724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b6239-dc5a-48a1-9714-3766f56eee51 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:46.884933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:46.885865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:46.886636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:46.887059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:46.887862 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:46.889995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:46.926162 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1179/2356] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:46.928308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:46.943689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e5462-9a29-43df-b208-0d8de06ba616 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.044744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.045660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.046153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.046644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.047511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.051240 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.088881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1178/2357] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:46 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:47.095781 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.119050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12db4e-06ce-4f78-b8e9-8c8a7bdc107b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.124913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.125588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.125928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.126206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.127488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.130556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.145695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1180/2358] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:47.147230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.160672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8136-ce75-45bb-8a0d-2f1d97773e69 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.166663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.167266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.167683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.167963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.168608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.170238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055f46-a361-428d-9786-604e52f1339a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.182393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1179/2359] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:47.186729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.202812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45983-980d-4098-8ed7-b419448376b0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.210331 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.218088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.218408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.218674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] PATH_INFO: `/v3/projects/ba4c27166810490092851fe2499f4f49/users/97fbfe7285154ee7a09f60ad1b7785ef/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.236563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4c27166810490092851fe2499f4f49, user_id=97fbfe7285154ee7a09f60ad1b7785ef, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.240622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.269533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1181/2360] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:47 2022] PUT /identity/v3/projects/ba4c27166810490092851fe2499f4f49/users/97fbfe7285154ee7a09f60ad1b7785ef/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:47.286669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.286954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.287228 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.324912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] MFA Rules not processed for user `97fbfe7285154ee7a09f60ad1b7785ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:47.326215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:47.410973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1180/2361] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:47.416011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.493459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30452077-c63f-41e5-ad59-47c8c2f67bb5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.498817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.499796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.500241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.500678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.501606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.504981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.536485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1182/2362] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:47 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:47.541301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.555561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc9cb-1ae8-4371-8315-877691f7059a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.610758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:47.620656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.621477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.621886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.622325 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.623517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.626627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.661708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1181/2363] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:47 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:47.665999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.677787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310277-2268-4f5b-8cae-f01e4300a00a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.682533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.683159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.683438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.683736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.684354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.685990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.697773 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1183/2364] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:47.702075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.712917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248ab6-4057-438b-88be-4894092d856d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.719232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.720007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.720365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.720662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] PATH_INFO: `/v3/projects/483610dc6af14a368cadb1ed8b630b3d/users/a8d9330800484599901d1887fc8d2784/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.739833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483610dc6af14a368cadb1ed8b630b3d, user_id=a8d9330800484599901d1887fc8d2784, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.742783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.759424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1182/2365] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:47 2022] PUT /identity/v3/projects/483610dc6af14a368cadb1ed8b630b3d/users/a8d9330800484599901d1887fc8d2784/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:47.764820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.776401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3206-5c86-4159-9bc1-ced9ccfecc2e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.817281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:47.869750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.870699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.871167 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.871630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.872734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.875704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c9ca3-565c-423d-ad8d-a92b97d8aec5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.895240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1184/2366] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:47.901848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:47.920927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7fbd2-1450-48ff-af52-ab037542bcd4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:47.929452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:47.930567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.931050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.931532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] PATH_INFO: `/v3/projects/483610dc6af14a368cadb1ed8b630b3d/users/a8d9330800484599901d1887fc8d2784/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:47.934881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=483610dc6af14a368cadb1ed8b630b3d, user_id=a8d9330800484599901d1887fc8d2784, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:47.939955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:47.958454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1183/2367] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:47 2022] PUT /identity/v3/projects/483610dc6af14a368cadb1ed8b630b3d/users/a8d9330800484599901d1887fc8d2784/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:47.975933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:47.976339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:47.976626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:48.005667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] MFA Rules not processed for user `a8d9330800484599901d1887fc8d2784`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:48.006821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:48.078853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1185/2368] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:48.095431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:48.098650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:48.188783 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99175468-7855-45ca-8c99-540f2aa0d29a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:48.193788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:48.194441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:48.194766 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:48.195194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:48.205533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:48.207992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:48.227750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1184/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:48.385667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:48.397555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2b662-8df4-464d-a677-c6275e1e4f3b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:48.402422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:48.403221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:48.403797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:48.404476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:48.502239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:48.505675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b395ab-f9e1-4349-95f9-bb1a4d3d50a0 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:48.523283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1186/2370] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:51.484079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:51.573785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b3843-0874-43ee-8c6f-556fab761312 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:51.581769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:51.582786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:51.583276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:51.583745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] PATH_INFO: `/v3/users/97fbfe7285154ee7a09f60ad1b7785ef` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:51.585800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fbfe7285154ee7a09f60ad1b7785ef)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:51.589531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:51.656335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fbfe7285154ee7a09f60ad1b7785ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:51.662996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:51.667945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fbfe7285154ee7a09f60ad1b7785ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:51.686209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fbfe7285154ee7a09f60ad1b7785ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:51.695457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fbfe7285154ee7a09f60ad1b7785ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:51.696238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fbfe7285154ee7a09f60ad1b7785ef'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:51.703906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1185/2371] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:51 2022] DELETE /identity/v3/users/97fbfe7285154ee7a09f60ad1b7785ef => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:51.710211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e3e88-8790-4504-a334-4663506715fc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:51.710709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e3e88-8790-4504-a334-4663506715fc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:51.710799 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e3e88-8790-4504-a334-4663506715fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:51.738186 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-186e3e88-8790-4504-a334-4663506715fc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:51.739921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-186e3e88-8790-4504-a334-4663506715fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:51.805108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:51.835658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1187/2372] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:51.848334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:51.850768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:51.949388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744ca1e-26b1-4970-b790-53acf963e2ef admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:51.953467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:51.954119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:51.954401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:51.954822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:51.964814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:51.966386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:51.978024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1186/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:52.462199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e3e88-8790-4504-a334-4663506715fc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:52.464606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-186e3e88-8790-4504-a334-4663506715fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:52.493178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e3e88-8790-4504-a334-4663506715fc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:52.499957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:52.501240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:52.501611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:52.501950 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] PATH_INFO: `/v3/projects/ba4c27166810490092851fe2499f4f49` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:52.504231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4c27166810490092851fe2499f4f49)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:52.506494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:52.573717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4c27166810490092851fe2499f4f49', 'request_id': 'req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.583606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4c27166810490092851fe2499f4f49', 'request_id': 'req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.591645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4c27166810490092851fe2499f4f49', 'request_id': 'req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.610750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] The token cache is being invalidate because project ba4c27166810490092851fe2499f4f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:52.611227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.612067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.621838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1188/2374] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:52 2022] DELETE /identity/v3/projects/ba4c27166810490092851fe2499f4f49 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:52.629031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:52.645547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0c12-d190-4333-8dc4-c3eae595a118 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:52.738942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:52.739586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:52.739896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:52.740173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] PATH_INFO: `/v3/users/a8d9330800484599901d1887fc8d2784` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:52.741818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d9330800484599901d1887fc8d2784)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:52.744055 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:52.831180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d9330800484599901d1887fc8d2784'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.850675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d9330800484599901d1887fc8d2784'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.874413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d9330800484599901d1887fc8d2784'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.879377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:52.890586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d9330800484599901d1887fc8d2784'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.892465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8b51750-5de8-4a77-98b4-47e92a0317a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d9330800484599901d1887fc8d2784'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:52.903026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1187/2375] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:52 2022] DELETE /identity/v3/users/a8d9330800484599901d1887fc8d2784 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:53.255495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:53.257304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:53.278066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f88ced-bc2c-4548-92bb-1a8b158a5b8f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:53.356281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:53.356945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.357303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.357676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] PATH_INFO: `/v3/projects/483610dc6af14a368cadb1ed8b630b3d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.359154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=483610dc6af14a368cadb1ed8b630b3d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:53.361245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:53.453240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483610dc6af14a368cadb1ed8b630b3d', 'request_id': 'req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:53.461056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483610dc6af14a368cadb1ed8b630b3d', 'request_id': 'req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:53.470898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483610dc6af14a368cadb1ed8b630b3d', 'request_id': 'req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:53.485770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:53.497475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] The token cache is being invalidate because project 483610dc6af14a368cadb1ed8b630b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:53.498109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:53.499720 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-976748e4-45b8-46b5-a06c-f5e9d56cf7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:53.501003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1189/2376] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:53 2022] DELETE /identity/v3/projects/483610dc6af14a368cadb1ed8b630b3d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:53.508946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.509928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.510233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.570099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:53.575647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:53.707949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1188/2377] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:53.718487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.718998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.719585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.729471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:53.731565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:53.755756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:53.758053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:53.777517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1190/2378] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:53.779228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:53.795777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96dadf-c74a-4411-8c46-10ec0e9bca7f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:53.801495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:53.802284 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.802669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.804213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.804213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:53.804213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:53.805964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:53.825094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1191/2379] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:53.825338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:53.841022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254679-79cb-4599-b3e0-21b1c8d99102 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:53.848251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:53.848973 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.849335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.849840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.850975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:53.853234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:53.866315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d8b5c-fb44-4bf6-972f-6c82e50348cf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:53.877826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:53.879101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:53.879604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:53.880024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:53.883007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:53.896685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1192/2380] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:53 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:53.897847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:53.907071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:53.910997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:53.929754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1189/2381] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:54.046896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834e93-ef1c-486b-81e2-e1bd77620d00 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:54.063688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:54.064467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.064741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.065599 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.066269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:54.072450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:54.127818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1193/2382] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:53 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:54.132471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:54.152601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89882-41f8-4345-a8e5-4a811f4a5ec1 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:54.160937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:54.161846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.162223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.162616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.163372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:54.165380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:54.179113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1190/2383] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:54.183291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:54.195489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719a3e-402c-4522-897b-2e07aca0204f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:54.201425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:54.202072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.202354 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.202631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.203295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:54.204899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5856c-947f-4fa3-b61f-b92c7df6f645 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:54.217661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1194/2384] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:05:54.222583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:54.234740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e29c-2d10-4365-8144-ba78e5f51174 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:54.241394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:54.242101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.242492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.242914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] PATH_INFO: `/v3/projects/cbf9eae9414f4d42be969667ac34a8c2/users/14cc2985cfaf47058ea735efd7217848/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.262635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9eae9414f4d42be969667ac34a8c2, user_id=14cc2985cfaf47058ea735efd7217848, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:54.265756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:54.295013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1191/2385] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:05:54 2022] PUT /identity/v3/projects/cbf9eae9414f4d42be969667ac34a8c2/users/14cc2985cfaf47058ea735efd7217848/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:54.366161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ae5e-05c7-4176-bd92-c1a646f80c3f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.367026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ae5e-05c7-4176-bd92-c1a646f80c3f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.367026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ae5e-05c7-4176-bd92-c1a646f80c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.402674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e111ae5e-05c7-4176-bd92-c1a646f80c3f None None] MFA Rules not processed for user `14cc2985cfaf47058ea735efd7217848`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:54.404659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e111ae5e-05c7-4176-bd92-c1a646f80c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:54.490282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1195/2386] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:54.507677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:54.510321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:54.569960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:54.586695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdcad9-829f-4216-a5ae-a13d5d02025f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:54.590400 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:54.590998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:54.591536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:54.591811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:54.605518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:54.606954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:54.621420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1192/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:56.637514 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:56.639050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:56.639502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:56.671605 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:56.673288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:56.705289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:56.767016 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1196/2388] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:56.805692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:56.805692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:56.895545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a0415-9a68-4a14-811c-a0d5a16fd8a4 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:56.912667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:56.912667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:56.912667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:56.912667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:56.927154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:56.927602 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7addc-6256-46b9-b0de-dc702427d626 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:56.939158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1193/2389] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:05:58.459467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:58.552258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7ee4-2262-416e-b7f5-2f3e3030b3c5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:58.560062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:58.561108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:58.561640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:58.562063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] PATH_INFO: `/v3/users/14cc2985cfaf47058ea735efd7217848` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:58.564113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cc2985cfaf47058ea735efd7217848)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:58.568146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:58.642446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cc2985cfaf47058ea735efd7217848'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:58.652897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cc2985cfaf47058ea735efd7217848'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:58.653867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cc2985cfaf47058ea735efd7217848'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:58.668802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cc2985cfaf47058ea735efd7217848'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:58.676945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cc2985cfaf47058ea735efd7217848'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:58.687562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1197/2390] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:05:58 2022] DELETE /identity/v3/users/14cc2985cfaf47058ea735efd7217848 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:05:58.695297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:58.696102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:58.696102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:58.721986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:58.723237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:58.800565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1194/2391] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:05:58.812936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:58.814423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:58.894881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8f9c-8be3-4341-a46e-9620de869b89 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:58.898684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:58.899280 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:58.899573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:58.899803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:58.905942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:58.912628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:58.914129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b434-f8b0-4d77-aaa6-5f98c33a85f6 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:58.926985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1198/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:05:59.249772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:59.251583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:59.277340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ea81-1e43-47b9-b788-7c2182251ebd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:59.282912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:59.284092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.285664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.285664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] PATH_INFO: `/v3/projects/cbf9eae9414f4d42be969667ac34a8c2` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.287385 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf9eae9414f4d42be969667ac34a8c2)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:59.291040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:59.361989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf9eae9414f4d42be969667ac34a8c2', 'request_id': 'req-3a34a08e-f681-482b-a5ec-407b0c41396c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:59.373660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf9eae9414f4d42be969667ac34a8c2', 'request_id': 'req-3a34a08e-f681-482b-a5ec-407b0c41396c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:59.387403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf9eae9414f4d42be969667ac34a8c2', 'request_id': 'req-3a34a08e-f681-482b-a5ec-407b0c41396c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:59.399316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:59.417623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] The token cache is being invalidate because project cbf9eae9414f4d42be969667ac34a8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:05:59.418773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:59.420036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a34a08e-f681-482b-a5ec-407b0c41396c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:05:59.425744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1195/2393] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:05:59 2022] DELETE /identity/v3/projects/cbf9eae9414f4d42be969667ac34a8c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:05:59.432591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.433113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.433767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.468468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:59.470537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:59.566727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1199/2394] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:59.579723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.580926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.581979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.616437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:05:59.618096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:05:59.635297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1196/2395] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:05:59.642265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:59.662517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9818c-791f-4192-8397-383c59fa4f1b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:59.671800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:59.672785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.673243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.673726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.675567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:05:59.676262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:59.679089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:59.706293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1200/2396] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:05:59.707656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:59.717159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc0585-afc6-4752-9ca3-9274fd48c439 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:59.723150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:59.723760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.724037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.724305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.724947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:59.726871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:59.766968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1197/2397] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:05:59.769371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:59.786336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25f91f-2ff9-46ec-b032-63109144d5b8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:59.886373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:59.887414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.887879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.888346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.889524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:59.893928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:59.931368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1201/2398] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:05:59 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:05:59.937731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:05:59.956127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c10da-7319-4da3-9eb1-7f1cf98b9589 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:05:59.964532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:05:59.965660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:05:59.966605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:05:59.967558 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:05:59.968928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:05:59.973067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:05:59.993645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1198/2399] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:05:59.995765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:00.014170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b13b33-1ad6-4df5-b31d-94095d439cee admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:00.022672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:00.024333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:00.024895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:00.025471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:00.027476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:00.030793 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014918-b7bc-4b25-a9fd-7413e0ec7cd4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:00.049578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1202/2400] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:00.054104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:00.070450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b48-2250-479b-a9cc-b47a81d2d6c6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:00.087656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:00.088933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:00.089430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:00.089957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] PATH_INFO: `/v3/projects/ed3d1e54fa9e4417a06f85ef2e35aee0/users/3138af0faa71424e946c6ceb89bd805e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:00.121450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3d1e54fa9e4417a06f85ef2e35aee0, user_id=3138af0faa71424e946c6ceb89bd805e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:00.128037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:00.155459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1199/2401] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:00 2022] PUT /identity/v3/projects/ed3d1e54fa9e4417a06f85ef2e35aee0/users/3138af0faa71424e946c6ceb89bd805e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:00.174110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:00.174448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:00.174835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:00.223380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] MFA Rules not processed for user `3138af0faa71424e946c6ceb89bd805e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:00.226347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:00.310701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:00.338217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1203/2402] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:00.358238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:00.360358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:00.459346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba5fda-d76a-4aa8-a29f-4441b9b21e4e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:00.465095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:00.465868 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:00.466153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:00.466614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:00.479728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:00.482377 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:00.499997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1200/2403] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:01.306697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:01.311991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:01.519144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33856f3f-1fcb-41d3-9d6c-c380552a2210 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:01.549641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:01.550524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:01.550808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:01.551088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:01.555068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:01.578596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:01.580966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:01.593717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1204/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:09.437803 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:09.440953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:09.520250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ad7eb-5931-48f9-ae64-cd3f0b9a1974 service glance] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:09.526248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:09.527225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:09.527694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:09.528194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:09.535221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:09.630863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:09.656392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:09.659533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:09.679592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1201/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:11.588676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=39 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:12.264869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:12.276999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea52c2-9dcb-4ffb-902f-6a2b7459105a service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:12.282257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:12.282995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:12.283414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:12.283910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:12.286629 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:12.309763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:12.311866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:12.329008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1205/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:14.754360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:14.756459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:14.858271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:14.861584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6350-96e5-48c5-8835-19a3e7243f5a service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:14.861774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:14.868064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:14.869354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:14.869979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:14.870988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:14.880181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:14.898045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc8ac-90e7-4108-9bb4-7392e6f5898a service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:14.901231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:14.903308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:14.911417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:14.913422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:14.914017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:14.914627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] PATH_INFO: `/v3/users/af3f4441d96c4343b655b13d60eed759` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:14.917723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3f4441d96c4343b655b13d60eed759)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:14.922022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:14.926834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1202/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:15.019825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3f4441d96c4343b655b13d60eed759'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.030392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3f4441d96c4343b655b13d60eed759'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.031203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3f4441d96c4343b655b13d60eed759'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.049860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3f4441d96c4343b655b13d60eed759'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.060499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eaf62de9-3ce8-4844-84b6-4c5623285b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3f4441d96c4343b655b13d60eed759'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.071080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1206/2408] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:14 2022] DELETE /identity/v3/users/af3f4441d96c4343b655b13d60eed759 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:15.485152 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:15.517769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c21dbb-4155-46d9-9be6-f5f228caa524 service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:15.667534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:15.669532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:15.670083 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:15.670417 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] PATH_INFO: `/v3/projects/2557b4276b764606956af532cd04f79c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:15.674347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2557b4276b764606956af532cd04f79c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:15.676509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:15.768397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2557b4276b764606956af532cd04f79c', 'request_id': 'req-6268948e-731f-4266-bca4-1893c4b300e1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.778252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2557b4276b764606956af532cd04f79c', 'request_id': 'req-6268948e-731f-4266-bca4-1893c4b300e1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.786321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2557b4276b764606956af532cd04f79c', 'request_id': 'req-6268948e-731f-4266-bca4-1893c4b300e1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.805328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] The token cache is being invalidate because project 2557b4276b764606956af532cd04f79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:15.805816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.806895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6268948e-731f-4266-bca4-1893c4b300e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:15.808873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1203/2409] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:15 2022] DELETE /identity/v3/projects/2557b4276b764606956af532cd04f79c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:15.815686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:15.816464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:15.817159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:15.855108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:15.857174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:15.977417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1207/2410] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:15.986734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:15.986989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:15.987195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.002930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:16.009236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:16.010849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:16.026384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1204/2411] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:16.027693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.058236 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09d9a-e095-43aa-87dd-844296f192e4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.067292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.067292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.067292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.067826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.068873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:16.069316 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.072288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.154307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1208/2412] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:16.162316 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.185008 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6108-78fa-41e4-90e5-af31514fe5f8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.206012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.207062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.207560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.208049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.209161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.212739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.308295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1205/2413] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:16 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:16.316042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.335735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9351c8-91e2-40df-b90e-eccb59eb8142 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.395791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:16.420131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.420746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.421020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.421315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.421993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.424579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.452255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1209/2414] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:16 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:16.456850 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.474759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761577-4200-4c35-9e36-031f79d5725e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.482922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.485185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.486666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.487355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.488957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.491453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.509551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1206/2415] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:16.514474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.529622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac54a72-c168-472e-a86e-5e423c447436 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.538767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.539917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.540314 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.540718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.544132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.544132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366dc61-b6b6-4380-936c-0604ad12365e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.567714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1210/2416] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:16.572187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:16.608623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7ae27-3058-4494-9c63-c0bdfb3cd9d2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:16.618077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:16.619203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.619554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.619954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] PATH_INFO: `/v3/projects/4ae4ff52852c4bb9a151ace4d78b1ff1/users/5449a65be53544f198d60d2fa7a4bbcb/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.672586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae4ff52852c4bb9a151ace4d78b1ff1, user_id=5449a65be53544f198d60d2fa7a4bbcb, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:16.679151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:16.715028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1207/2417] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:16 2022] PUT /identity/v3/projects/4ae4ff52852c4bb9a151ace4d78b1ff1/users/5449a65be53544f198d60d2fa7a4bbcb/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:16.729335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:16.729818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:16.730177 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:16.774464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] MFA Rules not processed for user `5449a65be53544f198d60d2fa7a4bbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:16.776436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:16.887348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1211/2418] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:16.893761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.021057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf5e34-67ee-4af7-bff2-bb002914f54b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.030926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.031997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.032702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.034277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.037211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.041466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.119018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1208/2419] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:16 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:17.123303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.139593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a09a8e-c0cb-4dc7-8102-d7e864ba4c0d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.273137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.274188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.274188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.275013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.276109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.277313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.320322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1212/2420] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:17 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:17.324799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.343338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703b95c-af45-4d26-93dc-629f8fd2941e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.354262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.356825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.357116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.357402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.358143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.359980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.385627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1209/2421] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:17.390703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.427493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab083b1-6d8d-48e5-b90d-fd46e06a520d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.435530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.436916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.437427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.437931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] PATH_INFO: `/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1/users/b9ba83dfa85e44d59c15dd42e93e5166/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.468695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a78afcd484a3aa58dd4f58c5a56d1, user_id=b9ba83dfa85e44d59c15dd42e93e5166, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.473738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.502929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1213/2422] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:17 2022] PUT /identity/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1/users/b9ba83dfa85e44d59c15dd42e93e5166/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:17.508771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.521065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.524643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:17.530408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d32c2-4cfa-4ff4-a16f-7349486a064a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.583673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:17.644728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.646232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.646816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.647345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.648482 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.651560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.678703 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1210/2423] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:17.701814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:17.702044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f45af-c68b-40e4-9c37-ab040086de77 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.702239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0978160-91d0-46a8-b060-747975db64a5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:17.704563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.705729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.706865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.708559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] PATH_INFO: `/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1/users/b9ba83dfa85e44d59c15dd42e93e5166/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.710983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:17.711997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.712600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.712953 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] PATH_INFO: `/v3/users/b0dc5717680e45268974b5912e8c7308` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.716128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a78afcd484a3aa58dd4f58c5a56d1, user_id=b9ba83dfa85e44d59c15dd42e93e5166, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.722194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0dc5717680e45268974b5912e8c7308)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:17.726672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.729637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6b36-b0b5-4927-8c60-5c6d33c5942b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:17.752972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:17.768236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1211/2424] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:17 2022] PUT /identity/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1/users/b9ba83dfa85e44d59c15dd42e93e5166/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:17.781909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:17.784839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:17.784839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:17.830523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] MFA Rules not processed for user `b9ba83dfa85e44d59c15dd42e93e5166`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:17.835667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:17.903625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0dc5717680e45268974b5912e8c7308'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:17.923447 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0dc5717680e45268974b5912e8c7308'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:17.926159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0dc5717680e45268974b5912e8c7308'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:17.959699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0dc5717680e45268974b5912e8c7308'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:17.998398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0dc5717680e45268974b5912e8c7308'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.009699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1212/2425] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:18.010999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1214/2426] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:17 2022] DELETE /identity/v3/users/b0dc5717680e45268974b5912e8c7308 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:18.024557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:18.026918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:18.153121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2f86-93d0-4221-ad39-2b3d527b3ba7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:18.238929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:18.240012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.240565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.241041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.332922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:18.337124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:18.339025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e4d6-93ca-42b9-b849-dd7bbc83b37e service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:18.353023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1213/2427] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:18.361376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:18.363632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:18.457283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630796-e281-4d14-8635-7b944d2bc9fa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:18.462210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:18.462850 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.463130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.463400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] PATH_INFO: `/v3/projects/c11e3437e93946f8acd31f37a9974d1c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.464563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11e3437e93946f8acd31f37a9974d1c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:18.466641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:18.545056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:18.553360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11e3437e93946f8acd31f37a9974d1c', 'request_id': 'req-3072181f-27fb-4cbe-b821-afd118785080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.562873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11e3437e93946f8acd31f37a9974d1c', 'request_id': 'req-3072181f-27fb-4cbe-b821-afd118785080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.570706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11e3437e93946f8acd31f37a9974d1c', 'request_id': 'req-3072181f-27fb-4cbe-b821-afd118785080'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.592450 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] The token cache is being invalidate because project c11e3437e93946f8acd31f37a9974d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:18.592966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.594134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3072181f-27fb-4cbe-b821-afd118785080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:18.603468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1215/2428] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:18 2022] DELETE /identity/v3/projects/c11e3437e93946f8acd31f37a9974d1c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:18.605137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.605559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.605992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.630743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:18.634299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:18.738319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1214/2429] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:18.748794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.749296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.749827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.777717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:18.780165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:18.794764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1216/2430] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:18.802128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:18.817799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebac61-4dd3-4ad8-be70-e1f9644aaad8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:18.828883 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:18.830473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.830966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.831423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.832583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:18.833108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:18.836594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:18.868687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1215/2431] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:18.870451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:18.882840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055f90-fff1-4d36-8a9c-46eef44e4d35 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:18.891504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:18.892778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:18.893402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:18.894059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:18.895273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:18.899061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:18.943008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1217/2432] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:18 2022] POST /identity/v3/projects => generated 403 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:18.947802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:18.958963 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b537eda-a637-40ba-aad4-b6a56d111b77 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.000873 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.003466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.038460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.039094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.039335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.039608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.040266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.042397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.069162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1216/2433] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:18 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:19.078089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.100614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d825e8-a125-4a87-9dc7-cbdad8008f7e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.102086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e119ca-ba2d-4e53-94bd-b947617a3a2a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.108128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.108856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.109133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.109404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] PATH_INFO: `/v3/users/5449a65be53544f198d60d2fa7a4bbcb` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.110525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.111613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5449a65be53544f198d60d2fa7a4bbcb)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.111960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.112548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.113152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.113447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.114174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.117084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.138148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1217/2434] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:19.140302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.157062 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a566f0-ee32-4e35-995e-781082c77b3d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.166153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.167098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.167500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.167980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.168904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.171326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.174268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5449a65be53544f198d60d2fa7a4bbcb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:19.186502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5449a65be53544f198d60d2fa7a4bbcb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:19.187918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5449a65be53544f198d60d2fa7a4bbcb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:19.197554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1218/2435] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:19.200248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.202611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.219497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5449a65be53544f198d60d2fa7a4bbcb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:19.224227 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82838-bfc9-4c7a-9a07-03e28e7b4d18 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.230683 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.231742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.232156 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.232622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] PATH_INFO: `/v3/projects/370826a24cf546c08920188e270e3846/users/19c9fc4c2f384877abaebdf7c080984e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.238022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf17fe1a-d8ac-4f4c-8e0e-c002b454851d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5449a65be53544f198d60d2fa7a4bbcb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:19.248708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1218/2436] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:18 2022] DELETE /identity/v3/users/5449a65be53544f198d60d2fa7a4bbcb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:19.254898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.255307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.255760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.261886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370826a24cf546c08920188e270e3846, user_id=19c9fc4c2f384877abaebdf7c080984e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.267666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445ec2-74f1-4faa-a051-e609eac0b238 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.290289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:19.291941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.295560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1219/2437] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:19 2022] PUT /identity/v3/projects/370826a24cf546c08920188e270e3846/users/19c9fc4c2f384877abaebdf7c080984e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:19.303190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.303763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.304294 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.316182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:19.344688 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:19.346795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.380076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:19.411031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1219/2438] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:19.429832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.432396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.473961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1220/2439] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:19.487770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:19.489712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:19.563376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5709-3cf1-4cd4-8f45-0c8fe525bef7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.570791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.571869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.572363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.572931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.598114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.600869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.618009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1220/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:19.618465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fae39-b7ea-4df2-a523-57ec88605621 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:19.633754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:19.635564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:19.636063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:19.636730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:19.651446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:19.651446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:19.665298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1221/2441] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:20.090405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:20.093511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:20.117710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27b93e-bc96-4dae-8719-984c46c8c781 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:20.125069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:20.127344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:20.127597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:20.128675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] PATH_INFO: `/v3/projects/4ae4ff52852c4bb9a151ace4d78b1ff1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:20.130875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae4ff52852c4bb9a151ace4d78b1ff1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:20.134474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:20.232061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae4ff52852c4bb9a151ace4d78b1ff1', 'request_id': 'req-75f8ac4b-1606-4b22-8f09-1fc206481829'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.244546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae4ff52852c4bb9a151ace4d78b1ff1', 'request_id': 'req-75f8ac4b-1606-4b22-8f09-1fc206481829'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.256074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae4ff52852c4bb9a151ace4d78b1ff1', 'request_id': 'req-75f8ac4b-1606-4b22-8f09-1fc206481829'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.278943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] The token cache is being invalidate because project 4ae4ff52852c4bb9a151ace4d78b1ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:20.279260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.279923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-75f8ac4b-1606-4b22-8f09-1fc206481829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.281772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1221/2442] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:20 2022] DELETE /identity/v3/projects/4ae4ff52852c4bb9a151ace4d78b1ff1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:20.287637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:20.300190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e019-498b-4f0f-8bc7-39a6b37aff29 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:20.402411 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:20.403415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:20.403724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:20.403984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] PATH_INFO: `/v3/users/b9ba83dfa85e44d59c15dd42e93e5166` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:20.405260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ba83dfa85e44d59c15dd42e93e5166)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:20.408272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:20.483753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ba83dfa85e44d59c15dd42e93e5166'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.495182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ba83dfa85e44d59c15dd42e93e5166'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.512890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:20.515638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ba83dfa85e44d59c15dd42e93e5166'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.530073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ba83dfa85e44d59c15dd42e93e5166'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.531371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ba83dfa85e44d59c15dd42e93e5166'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:20.545463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1222/2443] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:20 2022] DELETE /identity/v3/users/b9ba83dfa85e44d59c15dd42e93e5166 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:20.677055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:20.678123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:20.678123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:20.740398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] MFA Rules not processed for user `19c9fc4c2f384877abaebdf7c080984e`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:20.742508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:20.816580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:20.891512 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1222/2444] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:20.894080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:20.898343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:21.041707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b1b57-5668-40c6-8a83-4a67915de179 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.049064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.049879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.050972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.050972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.051456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.053641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.066047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.067817 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:21.099145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340af0fe-55bf-40f6-bbce-44bddf140069 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.111457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.112900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.113459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.113960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] PATH_INFO: `/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.116144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1a78afcd484a3aa58dd4f58c5a56d1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.119985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.141195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1223/2445] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:20 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:21.142390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.205675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1a78afcd484a3aa58dd4f58c5a56d1', 'request_id': 'req-2f44c185-1198-4cf5-93e3-158d567b3882'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:21.213919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1a78afcd484a3aa58dd4f58c5a56d1', 'request_id': 'req-2f44c185-1198-4cf5-93e3-158d567b3882'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:21.223153 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1a78afcd484a3aa58dd4f58c5a56d1', 'request_id': 'req-2f44c185-1198-4cf5-93e3-158d567b3882'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:21.235163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaac44b-3927-49c6-8373-0f32017fb778 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.244380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] The token cache is being invalidate because project 5c1a78afcd484a3aa58dd4f58c5a56d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:21.244853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:21.245857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2f44c185-1198-4cf5-93e3-158d567b3882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:21.248597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1223/2446] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:21 2022] DELETE /identity/v3/projects/5c1a78afcd484a3aa58dd4f58c5a56d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:21.254297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222697-4bab-494b-a5ca-1814f4c1ce1c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.254687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222697-4bab-494b-a5ca-1814f4c1ce1c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.255051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222697-4bab-494b-a5ca-1814f4c1ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.283081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b1222697-4bab-494b-a5ca-1814f4c1ce1c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:21.284589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b1222697-4bab-494b-a5ca-1814f4c1ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:21.317946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.318851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.318851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.319144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.319755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.321922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.347576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1224/2447] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:21 2022] POST /identity/v3/users => generated 309 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:21.355472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.357559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:21.373890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aae85-06e6-4e35-ba01-d814576fc385 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.380373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1224/2448] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:21.382848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.383958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.384645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.385194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.386507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.389574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.391922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:21.395680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.396124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.396566 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.409466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1225/2449] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:21.413857 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.425301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:21.426473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:21.428589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e8f3e-b4df-424b-86b2-9b5c8a64b0b4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.434170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.435032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.435434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.435719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1225/2450] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:21.435888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] PATH_INFO: `/v3/projects/2903a8d854ac4cd38241c2585981349b/users/e069081c18734e278744234bfbdcb87c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.442620 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.452784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fabdf4-e576-4614-88d8-f876832501c4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.459021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.459642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.459920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.460188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.460846 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:21.461036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2903a8d854ac4cd38241c2585981349b, user_id=e069081c18734e278744234bfbdcb87c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.461209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.462778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.463700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.477173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1226/2451] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:06:21.482825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.492253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1226/2452] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:21 2022] PUT /identity/v3/projects/2903a8d854ac4cd38241c2585981349b/users/e069081c18734e278744234bfbdcb87c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:21.497175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ea9d-c760-45c6-aa41-e5776d51aabb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.498288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.558571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:21.580431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8ac7-63d7-420f-ae39-7e25350f85de admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.585719 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.586336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.586616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.586896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.587231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.587544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.587870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.588207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.588594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.589144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.589596 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.591763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.601819 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1227/2453] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:21.606118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.618660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ee13-964d-4bc7-bc1b-3a2c678a075e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.624429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.625621 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.625965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.626858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] PATH_INFO: `/v3/projects/2903a8d854ac4cd38241c2585981349b/users/e069081c18734e278744234bfbdcb87c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.631571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2903a8d854ac4cd38241c2585981349b, user_id=e069081c18734e278744234bfbdcb87c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.634884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.636428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1227/2454] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:21 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:21.640732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.651252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1228/2455] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:21 2022] PUT /identity/v3/projects/2903a8d854ac4cd38241c2585981349b/users/e069081c18734e278744234bfbdcb87c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:21.745168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f67-1b4c-4e02-a92b-93ebed87dc02 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.849065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.849683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.849971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.850248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.851158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.852861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.883218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1228/2456] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:21 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:21.889750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.911172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960688-ea52-480d-a875-177f0b49c3de admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.919098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.920108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.920595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.921082 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.922215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.925843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.942984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1229/2457] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:21.949974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:21.970377 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32478-8f22-4115-a77b-a49ca9bb223a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:21.975967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:21.976591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:21.976867 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:21.977137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:21.977835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:21.979471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0cc4-1542-4f11-bbdd-906b878eda64 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:21.993866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1229/2458] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:21.998592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.009788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445398-7ac9-4d21-b3a3-90bb47a86fa9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.014950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.015609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.015884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.016153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] PATH_INFO: `/v3/projects/2b9f933ecc964b5baada850ec58f08b3/users/d9f43035c695478e845db8ab28014eff/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.036718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9f933ecc964b5baada850ec58f08b3, user_id=d9f43035c695478e845db8ab28014eff, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.042203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.069917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1230/2459] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:21 2022] PUT /identity/v3/projects/2b9f933ecc964b5baada850ec58f08b3/users/d9f43035c695478e845db8ab28014eff/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:22.085852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.086258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.086680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.152433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] MFA Rules not processed for user `d9f43035c695478e845db8ab28014eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:22.153788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:22.245510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.284895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1230/2460] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:22.290594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.401814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414388-97d8-4af3-91a8-14839ec94bb5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.410960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.411970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.413140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.413140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.413523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.415492 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502870b-7e6c-477a-aa4a-989f17b5c326 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.453579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1231/2461] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:22 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:22.459699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.477876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524027-0f6a-4312-84c2-21d646552f90 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.584809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.585355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.585902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.599470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.601730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.602882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.603337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.603882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.604798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.609997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.635011 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] MFA Rules not processed for user `e069081c18734e278744234bfbdcb87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:22.637438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:22.651608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1231/2462] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:22 2022] POST /identity/v3/users => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:22.660029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.671981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfddff-15d2-4ba2-9da8-8b586451b5e0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.684683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.685727 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.686217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.686691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.687995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.691578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.714269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1232/2463] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:22.721199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.738979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b1225-5445-40b0-9da7-550cd13d9db4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.746863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.747907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.748292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.748736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] PATH_INFO: `/v3/projects/944db3170d534fada23b350578716070/users/db4fcdb7d6944b00b9dc7656f3f1cb1e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.774986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=944db3170d534fada23b350578716070, user_id=db4fcdb7d6944b00b9dc7656f3f1cb1e, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.780344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.787897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1232/2464] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:22.801975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1233/2465] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:22 2022] PUT /identity/v3/projects/944db3170d534fada23b350578716070/users/db4fcdb7d6944b00b9dc7656f3f1cb1e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:22.808447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.827891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1ce9a-3031-43dc-b868-3b5f5148cefc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.909727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.910522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.910912 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.911261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.911992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.913695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14870a05-62cb-4aa4-945a-ae28354f38ba admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.925157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1233/2466] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:22.929693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:22.941022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadb0d-0820-4879-9f16-a6e0cc87cbea admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:22.945926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:22.946602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.946878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.947154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] PATH_INFO: `/v3/projects/944db3170d534fada23b350578716070/users/db4fcdb7d6944b00b9dc7656f3f1cb1e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:22.950022 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=944db3170d534fada23b350578716070, user_id=db4fcdb7d6944b00b9dc7656f3f1cb1e, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:22.954053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:22.968588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1234/2467] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:22 2022] PUT /identity/v3/projects/944db3170d534fada23b350578716070/users/db4fcdb7d6944b00b9dc7656f3f1cb1e/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:22.980533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495002-17aa-4c32-a947-b8820283326f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:22.980980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495002-17aa-4c32-a947-b8820283326f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:22.981395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495002-17aa-4c32-a947-b8820283326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:23.035695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d0495002-17aa-4c32-a947-b8820283326f None None] MFA Rules not processed for user `db4fcdb7d6944b00b9dc7656f3f1cb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:23.037931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0495002-17aa-4c32-a947-b8820283326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:23.148795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1234/2468] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:23.160714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:23.163239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:23.250478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd31b03-9bd4-4d88-be92-9a9b442a2fda admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:23.255685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:23.256305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:23.256826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:23.257103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:23.277427 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:23.279425 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:23.297774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1235/2469] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:23.398653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0495002-17aa-4c32-a947-b8820283326f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:23.425941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0495002-17aa-4c32-a947-b8820283326f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:23.436940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:23.439071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:23.439359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:23.442378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:23.467717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:23.587895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:23.590864 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:23.607463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1235/2470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:24.396822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:24.441053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:24.491601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb236a-db32-41ee-ae96-38dffed7bf23 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:24.496406 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:24.497062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:24.497328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:24.497638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] PATH_INFO: `/v3/users/19c9fc4c2f384877abaebdf7c080984e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:24.498791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c9fc4c2f384877abaebdf7c080984e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:24.500751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:24.557641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c9fc4c2f384877abaebdf7c080984e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:24.569934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c9fc4c2f384877abaebdf7c080984e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:24.571079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c9fc4c2f384877abaebdf7c080984e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:24.587916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c9fc4c2f384877abaebdf7c080984e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:24.598456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c9fc4c2f384877abaebdf7c080984e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:24.604823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1236/2471] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:24 2022] DELETE /identity/v3/users/19c9fc4c2f384877abaebdf7c080984e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:24.859793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:24.873452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b41c-18a0-47be-b9ad-e9696b3ebbcb service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:24.984363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:24.984363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:24.984363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:24.984363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] PATH_INFO: `/v3/projects/370826a24cf546c08920188e270e3846` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:24.986498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370826a24cf546c08920188e270e3846)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:24.989388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:25.073014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370826a24cf546c08920188e270e3846', 'request_id': 'req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.085357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370826a24cf546c08920188e270e3846', 'request_id': 'req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.093451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370826a24cf546c08920188e270e3846', 'request_id': 'req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.118651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] The token cache is being invalidate because project 370826a24cf546c08920188e270e3846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:25.119170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.120185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.122378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1236/2472] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:24 2022] DELETE /identity/v3/projects/370826a24cf546c08920188e270e3846 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:25.127246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:25.129317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:25.147041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76310b90-8413-4a2c-b384-91e7a4555c1a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:25.246532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:25.246900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:25.247069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:25.247491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] PATH_INFO: `/v3/users/e069081c18734e278744234bfbdcb87c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:25.250287 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e069081c18734e278744234bfbdcb87c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:25.254965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:25.325266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:25.327254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e069081c18734e278744234bfbdcb87c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.346118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e069081c18734e278744234bfbdcb87c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.347371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e069081c18734e278744234bfbdcb87c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.371758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e069081c18734e278744234bfbdcb87c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.383443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e069081c18734e278744234bfbdcb87c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.394101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1237/2473] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:25 2022] DELETE /identity/v3/users/e069081c18734e278744234bfbdcb87c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:25.634360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:25.637336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:25.671319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6ae6-2ce7-493e-b7e3-69e6b12877a4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:25.739638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:25.774123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:25.775263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:25.775836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:25.776413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] PATH_INFO: `/v3/projects/2903a8d854ac4cd38241c2585981349b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:25.778535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2903a8d854ac4cd38241c2585981349b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:25.781773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:25.796831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:25.799686 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:25.822481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ef79-af15-4b3a-bfa5-9936b7cb54be admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:25.830563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:25.831794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:25.832422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:25.832863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] PATH_INFO: `/v3/users/3138af0faa71424e946c6ceb89bd805e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:25.834592 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3138af0faa71424e946c6ceb89bd805e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:25.837476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:25.859609 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2903a8d854ac4cd38241c2585981349b', 'request_id': 'req-e7a56f71-d795-41cb-9746-ee3177b2cc2c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.869774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2903a8d854ac4cd38241c2585981349b', 'request_id': 'req-e7a56f71-d795-41cb-9746-ee3177b2cc2c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.885387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2903a8d854ac4cd38241c2585981349b', 'request_id': 'req-e7a56f71-d795-41cb-9746-ee3177b2cc2c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.905431 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] The token cache is being invalidate because project 2903a8d854ac4cd38241c2585981349b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:25.906093 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.908095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e7a56f71-d795-41cb-9746-ee3177b2cc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.910839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1237/2474] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:25 2022] DELETE /identity/v3/projects/2903a8d854ac4cd38241c2585981349b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:25.916956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9d26-6289-421a-ac88-b3bb0904ac2b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:25.917855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9d26-6289-421a-ac88-b3bb0904ac2b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:25.918470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9d26-6289-421a-ac88-b3bb0904ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:25.928087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3138af0faa71424e946c6ceb89bd805e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.945753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3138af0faa71424e946c6ceb89bd805e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.946866 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3138af0faa71424e946c6ceb89bd805e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.953309 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5d6d9d26-6289-421a-ac88-b3bb0904ac2b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:25.956998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5d6d9d26-6289-421a-ac88-b3bb0904ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:25.965292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3138af0faa71424e946c6ceb89bd805e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.975344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-54344647-405a-4f45-bd56-dcaf92cb1c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3138af0faa71424e946c6ceb89bd805e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:25.990725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1238/2475] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:25 2022] DELETE /identity/v3/users/3138af0faa71424e946c6ceb89bd805e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:25.993313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:25.993842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:25.994346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.028672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:26.031189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:26.073356 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1238/2476] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:26.076090 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.076548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.076989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.111125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:26.112646 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:26.184508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1239/2477] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:26.200128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.204268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:26.212498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1239/2478] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:26.218443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.234642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f0113-8454-4a69-a54a-c9283c461ddc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.242292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.243383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.243847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.244305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.245379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:26.245739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.248209 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.260269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:26.277586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1240/2479] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:26.277586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.291121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd171-5438-4577-bd06-6a25d748c3e5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.297059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.298721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.299500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.299682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:26.300148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.301016 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.303371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.330374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ddfca-0cf9-4573-9ba0-d5bad402e3f9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.335659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.336576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.336991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.337393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.353840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1241/2480] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:26 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:26.354103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.355951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.356315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.378388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1240/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:26.465668 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738e4c4-3df7-44ae-bc73-fead0987bcf0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.474360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.475342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.475342 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.475689 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.476553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.478374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.509463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1242/2482] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:26 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:26.514444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.526925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871ae7f-78fb-4ce0-a535-fc746c8b171f service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.536554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.537611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.538094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.538541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.539519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.542157 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.557376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1241/2483] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:26.561655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.575160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c6463-991c-4e21-ac9b-f30aa6832aea admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.580860 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.581473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.582205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.582205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.582699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.584459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52f9d-0ed4-4bff-be90-425b67c63d86 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.596218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1243/2484] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:26.601011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.620618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0442d3-1e06-4d66-83a0-caa79e221797 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.630769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.631452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.631774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.632231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] PATH_INFO: `/v3/projects/9b0b531a5864468b9ae6a22f7b799f59/users/edc1bcc6602b4d4699c4c1dd6ed40b86/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.658540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0b531a5864468b9ae6a22f7b799f59, user_id=edc1bcc6602b4d4699c4c1dd6ed40b86, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.663784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.684517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1242/2485] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:26 2022] PUT /identity/v3/projects/9b0b531a5864468b9ae6a22f7b799f59/users/edc1bcc6602b4d4699c4c1dd6ed40b86/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:26.702957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.703384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.704131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.740013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] MFA Rules not processed for user `edc1bcc6602b4d4699c4c1dd6ed40b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:26.742029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:26.782107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.784612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:26.846168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1244/2486] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:26.852834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:26.872393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e091-ccac-4f82-9a8c-971466d793d3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.877463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:26.878213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:26.878584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:26.878869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] PATH_INFO: `/v3/projects/ed3d1e54fa9e4417a06f85ef2e35aee0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:26.880026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3d1e54fa9e4417a06f85ef2e35aee0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:26.882063 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:26.926491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:26.944205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3d1e54fa9e4417a06f85ef2e35aee0', 'request_id': 'req-03b98186-5147-4023-ae33-b5cf4120ec86'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:26.952312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3d1e54fa9e4417a06f85ef2e35aee0', 'request_id': 'req-03b98186-5147-4023-ae33-b5cf4120ec86'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:26.955150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2166-84b0-47e9-8b40-863db92806ce None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:26.961619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3d1e54fa9e4417a06f85ef2e35aee0', 'request_id': 'req-03b98186-5147-4023-ae33-b5cf4120ec86'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:26.979405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] The token cache is being invalidate because project ed3d1e54fa9e4417a06f85ef2e35aee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:26.979780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:26.980570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:26.982536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1243/2487] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:26 2022] DELETE /identity/v3/projects/ed3d1e54fa9e4417a06f85ef2e35aee0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:27.049817 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.050824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.051331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.051776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.053020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.056844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.101578 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1245/2488] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:26 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:27.107291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.109961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.134940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b98186-5147-4023-ae33-b5cf4120ec86 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.182471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:27.220995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.221855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.222238 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.222523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.223188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.225195 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.252714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1244/2489] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:27 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:27.257705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.276496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71802c-7c64-42d6-a62d-04a14c58c8cb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.285348 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.286389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.286823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.287234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.288382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.291321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.308195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1246/2490] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:27.312597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.324183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb38e-e4c6-4461-b1a2-1441ccd32da0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.329956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.330682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.330956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.331233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] PATH_INFO: `/v3/projects/18dbbbfeafe04a528f8d2449a5e144af/users/295d3011437b4f048c59c1259ff502d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.351119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18dbbbfeafe04a528f8d2449a5e144af, user_id=295d3011437b4f048c59c1259ff502d3, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.353828 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.368219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1245/2491] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:27 2022] PUT /identity/v3/projects/18dbbbfeafe04a528f8d2449a5e144af/users/295d3011437b4f048c59c1259ff502d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:27.373445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.384886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9230d-04cd-4d89-9263-3a46dd711834 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.463024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.463445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.463721 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.464126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.464619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.466360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960224-f8ba-435f-8608-b9bf2c38ccfa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.478007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1247/2492] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:27.483826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.503880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbba4-e5e0-42c1-9500-9408f86b2b5d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.511853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.513003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.513367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.513711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] PATH_INFO: `/v3/projects/18dbbbfeafe04a528f8d2449a5e144af/users/295d3011437b4f048c59c1259ff502d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.516321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18dbbbfeafe04a528f8d2449a5e144af, user_id=295d3011437b4f048c59c1259ff502d3, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.521654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.538842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1246/2493] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:27 2022] PUT /identity/v3/projects/18dbbbfeafe04a528f8d2449a5e144af/users/295d3011437b4f048c59c1259ff502d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:27.553202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.553511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.553822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.589806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] MFA Rules not processed for user `295d3011437b4f048c59c1259ff502d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:27.591122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.651504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.653414 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.670478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:27.708215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1248/2494] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:27.724069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.726358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.771576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359970-3d90-4d71-90f5-0fe61c9a477e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.784979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.785980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.786383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.786669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] PATH_INFO: `/v3/users/d9f43035c695478e845db8ab28014eff` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.788513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f43035c695478e845db8ab28014eff)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.791750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.807022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396e4d6-cfae-4beb-83fb-09cf9b874ba9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:27.811343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:27.812066 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.812401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.812734 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.824701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:27.826709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335d2bd-fe63-4d7b-b4fa-4fe1cba13520 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:27.841413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1249/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:27.859221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f43035c695478e845db8ab28014eff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:27.871222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f43035c695478e845db8ab28014eff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:27.872404 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f43035c695478e845db8ab28014eff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:27.897459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f43035c695478e845db8ab28014eff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:27.906012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f43035c695478e845db8ab28014eff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:27.915626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1247/2496] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:27 2022] DELETE /identity/v3/users/d9f43035c695478e845db8ab28014eff => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:27.929821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:27.929821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:27.929821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:27.942905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:27.944913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.948575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:27.949805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:27.951556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:28.023251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1250/2497] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:28.036539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8e9-9de9-4a96-926e-78b67f77e166 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:28.038293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:28.039730 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:28.043811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:28.044495 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:28.044962 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:28.045353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:28.047218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:28.145089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:28.146345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35d024-bad0-4f56-9746-405bf400d2e9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:28.147044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:28.150265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:28.150885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:28.151157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:28.151432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:28.162131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1248/2498] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:28.164127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:28.165742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:28.179428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1251/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:28.565393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:28.567536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:28.593249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399e8f-46c7-4552-9420-ea90371d5e9e service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:28.600337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:28.600991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:28.601267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:28.601578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] PATH_INFO: `/v3/projects/2b9f933ecc964b5baada850ec58f08b3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:28.602755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9f933ecc964b5baada850ec58f08b3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:28.604734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:28.659684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9f933ecc964b5baada850ec58f08b3', 'request_id': 'req-1f32c7fd-b98f-475d-98ea-67be06634a23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.667422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9f933ecc964b5baada850ec58f08b3', 'request_id': 'req-1f32c7fd-b98f-475d-98ea-67be06634a23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.677701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9f933ecc964b5baada850ec58f08b3', 'request_id': 'req-1f32c7fd-b98f-475d-98ea-67be06634a23'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.694879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] The token cache is being invalidate because project 2b9f933ecc964b5baada850ec58f08b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:28.695196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.695840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.697428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1249/2500] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:28 2022] DELETE /identity/v3/projects/2b9f933ecc964b5baada850ec58f08b3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:28.702125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:28.714371 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057d1b6-4787-44fe-a8e2-e79ed235591f service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:28.752047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:28.790320 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:28.791296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:28.791634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:28.791988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] PATH_INFO: `/v3/users/db4fcdb7d6944b00b9dc7656f3f1cb1e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:28.793680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4fcdb7d6944b00b9dc7656f3f1cb1e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:28.796893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:28.871075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4fcdb7d6944b00b9dc7656f3f1cb1e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.884231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4fcdb7d6944b00b9dc7656f3f1cb1e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.903658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4fcdb7d6944b00b9dc7656f3f1cb1e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.913716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4fcdb7d6944b00b9dc7656f3f1cb1e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.914697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fe4318c-b15d-48cf-b687-7c7f538308fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4fcdb7d6944b00b9dc7656f3f1cb1e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:28.921467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1252/2501] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:28 2022] DELETE /identity/v3/users/db4fcdb7d6944b00b9dc7656f3f1cb1e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:29.249834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:29.252285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:29.267373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c7fd-b98f-475d-98ea-67be06634a23 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:29.312642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:29.335471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:29.336473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.336956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.337423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] PATH_INFO: `/v3/projects/944db3170d534fada23b350578716070` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.339463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944db3170d534fada23b350578716070)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:29.343128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:29.431782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944db3170d534fada23b350578716070', 'request_id': 'req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:29.446918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944db3170d534fada23b350578716070', 'request_id': 'req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:29.456161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944db3170d534fada23b350578716070', 'request_id': 'req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:29.475575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] The token cache is being invalidate because project 944db3170d534fada23b350578716070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:29.475859 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:29.476526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ee0a3aef-8580-46e5-a9aa-83d900bb5c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:29.479181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1250/2502] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:29 2022] DELETE /identity/v3/projects/944db3170d534fada23b350578716070 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:29.487712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.488280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.488600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.524731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:29.526717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:29.625288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1253/2503] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:29.635833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.636365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.636897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.667885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:29.669213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:29.679794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1251/2504] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:29.685424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:29.697561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d309-38ee-4a2c-a1ca-e09309f79da9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:29.703138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:29.703808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.704645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.705467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.706134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:29.706446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:29.708369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:29.724389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1254/2505] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:29.729168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:29.747042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2654d9-92c8-4186-bc8f-2add40f103d5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:29.757412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:29.758534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.758968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.759431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.760524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:29.762660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:29.811249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:29.814000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1252/2506] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:29 2022] POST /identity/v3/projects => generated 409 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:29.826109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcac7e3-0e07-4194-b7f9-d8f060621b37 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:29.891949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:29.933196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:29.933884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.934256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.934633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.935392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:29.937836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:29.973530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1255/2507] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:29 2022] POST /identity/v3/users => generated 305 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:29.977018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:29.991125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512454f8-2b7a-4ef8-97eb-17f484d3db60 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:29.996954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:29.997730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:29.998086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:29.998369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:29.999134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.001217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.019240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1253/2508] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:30.024653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.042080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231e66-331b-4761-b262-3836922bc4d1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.051339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.052391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.052906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.053372 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.054525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.057357 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7408c-bbdd-458e-8da6-a6e1412e9191 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.077827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1256/2509] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:30.082448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.095553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717bd13-13c2-42f1-a54e-9fdfe9ebb04c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.103388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.104072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.104389 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.104626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] PATH_INFO: `/v3/projects/9390a4c55ef04e6c87f1ce4366369438/users/5c559cb86ae74e38b70843e4d63fd8e9/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.128664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9390a4c55ef04e6c87f1ce4366369438, user_id=5c559cb86ae74e38b70843e4d63fd8e9, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.133749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.155614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1254/2510] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:30 2022] PUT /identity/v3/projects/9390a4c55ef04e6c87f1ce4366369438/users/5c559cb86ae74e38b70843e4d63fd8e9/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:30.170071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.170355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.170631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.212185 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] MFA Rules not processed for user `5c559cb86ae74e38b70843e4d63fd8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:30.213330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:30.304448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1257/2511] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:30 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:30.309634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.388168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f453-a01b-413b-b717-87158f197b59 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.395291 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.396145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.396673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.397083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.397827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.399989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.418328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:30.439367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1255/2512] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:30 2022] POST /identity/v3/projects => generated 409 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:30.444813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.464131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e129771-bb10-4e9d-91ca-96214df595ac None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.539427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.540544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.540544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.540878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.541402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.543435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.570624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1258/2513] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:30 2022] POST /identity/v3/users => generated 311 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:30.575460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.587881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da57d86-24bf-4d98-8b9d-e1107021e4ba admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.594065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.594945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.595614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.595614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.596375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.598180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.612721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1256/2514] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:30.617458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.630435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfa26e-a658-4c14-9354-c41256b293b1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.636902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.637684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.638107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.638402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] PATH_INFO: `/v3/projects/82d8488f1f6e43479bf2701abb7a2c60/users/6a403727b25248f4ada3e883801b74d1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.659676 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d8488f1f6e43479bf2701abb7a2c60, user_id=6a403727b25248f4ada3e883801b74d1, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.662942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.683680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1259/2515] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:30 2022] PUT /identity/v3/projects/82d8488f1f6e43479bf2701abb7a2c60/users/6a403727b25248f4ada3e883801b74d1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:30.687981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.699469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da6a0-511a-425b-81ff-e0dd1046b0f2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.792602 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.793433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.793904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.794285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.795534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.797353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa629be-c019-4750-bc6c-c44b32517830 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.810783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1257/2516] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:30.815955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:30.828523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c1751-0c6f-48dd-bbad-376e69bd2d7a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:30.835663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:30.836572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.836917 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.837195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] PATH_INFO: `/v3/projects/82d8488f1f6e43479bf2701abb7a2c60/users/6a403727b25248f4ada3e883801b74d1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.839525 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d8488f1f6e43479bf2701abb7a2c60, user_id=6a403727b25248f4ada3e883801b74d1, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:30.842589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:30.851576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:30.861713 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1260/2517] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:30 2022] PUT /identity/v3/projects/82d8488f1f6e43479bf2701abb7a2c60/users/6a403727b25248f4ada3e883801b74d1/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:30.876027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:30.876322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:30.876641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:30.911000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] MFA Rules not processed for user `6a403727b25248f4ada3e883801b74d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:30.912253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:30.997660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1258/2518] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:30 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:31.011306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:31.013129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:31.106830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ba42b-83f3-46ec-ac0a-55f422d9a2bb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:31.116087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:31.117039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:31.117418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:31.118024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:31.131458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:31.134222 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:31.148134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1261/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:31.390748 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:31.409387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704339-6529-46a1-927c-0e7daf2736b3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:31.416017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:31.416661 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:31.416937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:31.417207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:31.507243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:31.508714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4fc26-ccf8-44ea-afb8-20431ea7e579 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:31.520506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1259/2520] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:31 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:35.707816 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:35.709511 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:35.801117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9d4bd-e6aa-45cb-a7f7-bcf1538261a6 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:35.809446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:35.810142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:35.810421 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:35.810695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] PATH_INFO: `/v3/users/edc1bcc6602b4d4699c4c1dd6ed40b86` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:35.811897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc1bcc6602b4d4699c4c1dd6ed40b86)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:35.814605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:35.875776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc1bcc6602b4d4699c4c1dd6ed40b86'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:35.893139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc1bcc6602b4d4699c4c1dd6ed40b86'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:35.912192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc1bcc6602b4d4699c4c1dd6ed40b86'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:35.921027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc1bcc6602b4d4699c4c1dd6ed40b86'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:35.922044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc1bcc6602b4d4699c4c1dd6ed40b86'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:35.933150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1262/2521] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:35 2022] DELETE /identity/v3/users/edc1bcc6602b4d4699c4c1dd6ed40b86 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:35.940983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:35.941536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:35.941536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:35.949298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:35.968518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:35.970572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:36.045288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1260/2522] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:36.056825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:36.058977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:36.104115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:36.161040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b312f-3b3c-46e5-a91c-af8612a90357 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:36.166030 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:36.169457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:36.169457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:36.169457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:36.184535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:36.186037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:36.197106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1263/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:36.549058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:36.550982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:36.566700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b563c76-5ca9-4783-a69d-4380c6bc0cf2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:36.572363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:36.573126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:36.573465 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:36.573997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] PATH_INFO: `/v3/projects/9b0b531a5864468b9ae6a22f7b799f59` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:36.575142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0b531a5864468b9ae6a22f7b799f59)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:36.577548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:36.648243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0b531a5864468b9ae6a22f7b799f59', 'request_id': 'req-e79dd27e-6229-4652-af70-ba8a8eaaa964'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.660305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0b531a5864468b9ae6a22f7b799f59', 'request_id': 'req-e79dd27e-6229-4652-af70-ba8a8eaaa964'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.670474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0b531a5864468b9ae6a22f7b799f59', 'request_id': 'req-e79dd27e-6229-4652-af70-ba8a8eaaa964'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.692468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] The token cache is being invalidate because project 9b0b531a5864468b9ae6a22f7b799f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:36.692751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.693536 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.695245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1261/2524] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:36 2022] DELETE /identity/v3/projects/9b0b531a5864468b9ae6a22f7b799f59 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:36.699978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:36.711643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44320ee-eb25-42e5-a942-86cf653f4bb1 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:36.806109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:36.806799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:36.807086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:36.807362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] PATH_INFO: `/v3/users/295d3011437b4f048c59c1259ff502d3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:36.808586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295d3011437b4f048c59c1259ff502d3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:36.810840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:36.888292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295d3011437b4f048c59c1259ff502d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.903898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295d3011437b4f048c59c1259ff502d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.927724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295d3011437b4f048c59c1259ff502d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.936812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295d3011437b4f048c59c1259ff502d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.937952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295d3011437b4f048c59c1259ff502d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:36.950648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1264/2525] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:36 2022] DELETE /identity/v3/users/295d3011437b4f048c59c1259ff502d3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:37.330020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.333100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.351796 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd27e-6229-4652-af70-ba8a8eaaa964 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.380595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.382670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.428906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:37.430218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.430494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.430763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] PATH_INFO: `/v3/users/5c559cb86ae74e38b70843e4d63fd8e9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.431927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c559cb86ae74e38b70843e4d63fd8e9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:37.433890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:37.458612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:37.478574 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:37.483182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca61d84-5330-45c3-b970-153791658211 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.490159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:37.491133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.491438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.491718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] PATH_INFO: `/v3/projects/18dbbbfeafe04a528f8d2449a5e144af` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.493464 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18dbbbfeafe04a528f8d2449a5e144af)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:37.495793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:37.512363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c559cb86ae74e38b70843e4d63fd8e9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.523020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c559cb86ae74e38b70843e4d63fd8e9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.523681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c559cb86ae74e38b70843e4d63fd8e9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.538895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c559cb86ae74e38b70843e4d63fd8e9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.556335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a51a95a8-c64c-4d7a-bc7d-ad98312b9180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c559cb86ae74e38b70843e4d63fd8e9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.559840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18dbbbfeafe04a528f8d2449a5e144af', 'request_id': 'req-bf50a862-d37b-4a1a-8a73-4fc00333163e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.574463 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18dbbbfeafe04a528f8d2449a5e144af', 'request_id': 'req-bf50a862-d37b-4a1a-8a73-4fc00333163e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.575388 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1262/2526] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:37 2022] DELETE /identity/v3/users/5c559cb86ae74e38b70843e4d63fd8e9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:37.581264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.581581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.581864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.582972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18dbbbfeafe04a528f8d2449a5e144af', 'request_id': 'req-bf50a862-d37b-4a1a-8a73-4fc00333163e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.601399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] The token cache is being invalidate because project 18dbbbfeafe04a528f8d2449a5e144af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:37.601926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.602048 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:37.602545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bf50a862-d37b-4a1a-8a73-4fc00333163e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:37.603136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.604380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1265/2527] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:37 2022] DELETE /identity/v3/projects/18dbbbfeafe04a528f8d2449a5e144af => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:37.610193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f9e7-4523-4b86-a9e5-2e435fc06aed None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.610704 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f9e7-4523-4b86-a9e5-2e435fc06aed None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.611382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f9e7-4523-4b86-a9e5-2e435fc06aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.636856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6432f9e7-4523-4b86-a9e5-2e435fc06aed None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:37.639302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6432f9e7-4523-4b86-a9e5-2e435fc06aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.697968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1263/2528] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:37.708402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.710137 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.730326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1266/2529] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:37.739099 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.739440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.739754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.764613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:37.765911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:37.775265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1267/2530] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:37.780115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ed54-21e0-4982-ad41-3a1a1ce44605 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.780317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.784278 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:37.785098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.785098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.785326 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.794508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367de0-bc53-45eb-8bfa-f259f58a7cd0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.796078 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:37.799675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:37.799923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:37.800335 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.800615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.800891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.801594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:37.801902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:37.804203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:37.813970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1264/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:37.828192 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1268/2532] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:06:37.830081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.840700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028cab3-f85f-435f-867d-66b94d3dc1c0 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.847698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:37.848537 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:37.849010 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:37.849502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:37.850545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:37.853033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:37.895786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1265/2533] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:37 2022] POST /identity/v3/projects => generated 355 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:37.901725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:37.918143 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ef93-3910-43fc-9c09-6edf890e9955 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:37.997094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:38.012791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.013696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.013976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.014248 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.014905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.017927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.042998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1269/2534] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:37 2022] POST /identity/v3/users => generated 278 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:38.047045 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.060382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599336-ae23-4df8-991a-a19c5101bbfe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.065974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.066606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.066885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.067163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.068585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.069523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.082518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1266/2535] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:38.087110 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.098955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932324c4-839c-4d21-991a-cec6a90164ab admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.107409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.108157 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.108479 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.108892 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.110312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.113031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.132827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1270/2536] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:38.139737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.160692 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e982785-47ae-447a-af33-432138eb96af admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.167756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.168307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.168880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.169557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.170124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] PATH_INFO: `/v3/projects/d58b7042408b405aadf8c5cb584a82ab/users/b1eab8cfbcf5425482e9766a473404f8/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.173191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:38.192707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5db5-ceba-4d26-909c-dfbdc45c06a0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.197973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.198655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.198935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.199216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] PATH_INFO: `/v3/projects/9390a4c55ef04e6c87f1ce4366369438` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.200390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:38.200529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9390a4c55ef04e6c87f1ce4366369438)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.202821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.215472 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58b7042408b405aadf8c5cb584a82ab, user_id=b1eab8cfbcf5425482e9766a473404f8, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.223099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fdd62-7903-4f36-87ab-c469e6b1e94b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.249588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1267/2537] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:38 2022] PUT /identity/v3/projects/d58b7042408b405aadf8c5cb584a82ab/users/b1eab8cfbcf5425482e9766a473404f8/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:38.260618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.261128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.261594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.280623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9390a4c55ef04e6c87f1ce4366369438', 'request_id': 'req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.290612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9390a4c55ef04e6c87f1ce4366369438', 'request_id': 'req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.299397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9390a4c55ef04e6c87f1ce4366369438', 'request_id': 'req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.301112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] MFA Rules not processed for user `b1eab8cfbcf5425482e9766a473404f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:38.302449 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:38.318109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] The token cache is being invalidate because project 9390a4c55ef04e6c87f1ce4366369438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:38.318626 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.319414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.325731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1271/2538] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:38 2022] DELETE /identity/v3/projects/9390a4c55ef04e6c87f1ce4366369438 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:38.331998 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.334104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:38.417612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1268/2539] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:38.420501 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.422210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:38.442979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956a9a-9ed4-4fff-a0f0-bfc3cad4217b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.443173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116763b8-2ca2-4fc2-8405-dfc91942aa80 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.448346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.448972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.449254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.449562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.450214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.451163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.452100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.452240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.452521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.452967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] PATH_INFO: `/v3/users/6a403727b25248f4ada3e883801b74d1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.455497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a403727b25248f4ada3e883801b74d1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.458199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.508270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1269/2540] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:38 2022] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:38.509802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.565168 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a403727b25248f4ada3e883801b74d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.580277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a403727b25248f4ada3e883801b74d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.589147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:38.606662 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a403727b25248f4ada3e883801b74d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.624321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a403727b25248f4ada3e883801b74d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.627202 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a403727b25248f4ada3e883801b74d1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:38.636881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3ba51-1312-4614-b669-7456b6c28d7b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.645538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.645538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.645538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.645538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.646271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.649197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.649556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1272/2541] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:38 2022] DELETE /identity/v3/users/6a403727b25248f4ada3e883801b74d1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:38.711932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1270/2542] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:38 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:38.713252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.715436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:38.836647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7ab3-ec32-449d-bd75-36f9069850b3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.846867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.847909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.848388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.849087 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.850050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.852546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.871378 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1273/2543] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:38.875341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.896837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac8659-97bb-407c-82f6-0533ec49de22 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:38.912684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:38.913764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:38.914453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:38.914722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] PATH_INFO: `/v3/projects/8244685bdca24064b858e1f2b642e74e/users/d23942bf74da4be086aa21334636623d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:38.935430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8244685bdca24064b858e1f2b642e74e, user_id=d23942bf74da4be086aa21334636623d, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:38.938849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:38.962619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1271/2544] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:38 2022] PUT /identity/v3/projects/8244685bdca24064b858e1f2b642e74e/users/d23942bf74da4be086aa21334636623d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:38.972032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:38.994273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876385-1703-451f-a0b8-427bf346b936 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.030413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.032561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:39.082281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:39.112359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.112359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.112886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.113088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.114120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.115833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.130270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1274/2545] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:39.136104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.153122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf4c1-7057-401a-9dea-c47c5393f37e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.159467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.160353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.160633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.160927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] PATH_INFO: `/v3/projects/8244685bdca24064b858e1f2b642e74e/users/d23942bf74da4be086aa21334636623d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.163251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8244685bdca24064b858e1f2b642e74e, user_id=d23942bf74da4be086aa21334636623d, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.167160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022fcd9-eb0a-4423-9596-3b35ca284f63 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.169286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207583f9-0401-4bab-bb62-d8178cb02304 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.175774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.177839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.178269 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.178847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] PATH_INFO: `/v3/projects/82d8488f1f6e43479bf2701abb7a2c60` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.181026 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d8488f1f6e43479bf2701abb7a2c60)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.184483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1275/2546] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:39 2022] PUT /identity/v3/projects/8244685bdca24064b858e1f2b642e74e/users/d23942bf74da4be086aa21334636623d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:39.184639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.198922 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.202213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.203301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.252562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] MFA Rules not processed for user `d23942bf74da4be086aa21334636623d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:39.253886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:39.280923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d8488f1f6e43479bf2701abb7a2c60', 'request_id': 'req-6c6feea0-6427-4fbc-a6fc-c3def7234a39'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:39.290463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d8488f1f6e43479bf2701abb7a2c60', 'request_id': 'req-6c6feea0-6427-4fbc-a6fc-c3def7234a39'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:39.300607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d8488f1f6e43479bf2701abb7a2c60', 'request_id': 'req-6c6feea0-6427-4fbc-a6fc-c3def7234a39'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:39.327931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] The token cache is being invalidate because project 82d8488f1f6e43479bf2701abb7a2c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:39.328298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:39.329808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6c6feea0-6427-4fbc-a6fc-c3def7234a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:39.334617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1272/2547] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:39 2022] DELETE /identity/v3/projects/82d8488f1f6e43479bf2701abb7a2c60 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:39.337110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba556-d399-4167-84cd-988cadc50ba6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.337557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba556-d399-4167-84cd-988cadc50ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.337936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba556-d399-4167-84cd-988cadc50ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.344588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:39.374002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c67ba556-d399-4167-84cd-988cadc50ba6 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:39.376123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c67ba556-d399-4167-84cd-988cadc50ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:39.396488 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1276/2548] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:39.414501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.416201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:39.493582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1273/2549] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:39.504576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268237-d426-4add-8980-f4ca798030ee None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.504948 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268237-d426-4add-8980-f4ca798030ee None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.505172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268237-d426-4add-8980-f4ca798030ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.513830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f248b4-b27f-4c9a-a537-58e89e15a890 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.536249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-44268237-d426-4add-8980-f4ca798030ee None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:39.538517 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-44268237-d426-4add-8980-f4ca798030ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:39.561614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1274/2550] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:39.564694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268237-d426-4add-8980-f4ca798030ee None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.595774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268237-d426-4add-8980-f4ca798030ee None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.602849 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.603634 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.604281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.605229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.606130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:39.606462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.609292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.652295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1275/2551] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:39.654130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.670326 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.671003 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.671284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.671554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.680060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e556e0-d28d-4aa2-8cb5-5f63c7911a0d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.690715 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.691609 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.696081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.696729 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.697664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.702652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.771505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1276/2552] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:39 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:39.773815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:39.798455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.800480 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:39.809819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:39.815953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1277/2553] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:39.971174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49981-36da-4605-8dc3-c0d51c016561 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:39.981438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:39.982884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:39.983098 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:39.983439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:39.984159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:39.996263 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.006338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.018281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334de30-44bd-4e62-b664-d900da199791 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.046770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1277/2554] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:39 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:40.052706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.067738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871f61-ec00-43b3-b74c-015218c9f9bb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.087101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.088181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.088705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.089140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.090183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.096830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.118780 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1278/2555] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:40.119109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.122888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:40.132073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.132525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eccea-2ff3-477a-972a-17e6d237d9c3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.133031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.133406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.134613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.136078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:40.141402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.142112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.142341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.142617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.143272 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.144880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.163096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1279/2556] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:40.176604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.194097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4a77-2b11-4d10-9627-05d60d757f34 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.199808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.200719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.201286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.201680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] PATH_INFO: `/v3/projects/78fbae00b7844354838e638c4fca87f6/users/2c1dad5cdd904b589b83eec43409d4e0/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.227009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fbae00b7844354838e638c4fca87f6, user_id=2c1dad5cdd904b589b83eec43409d4e0, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.232141 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57513df6-b3a8-49df-9f32-9bac3dd3f536 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.245120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.247562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.253794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1280/2557] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:40 2022] PUT /identity/v3/projects/78fbae00b7844354838e638c4fca87f6/users/2c1dad5cdd904b589b83eec43409d4e0/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:40.262567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1278/2558] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:40.264921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.265255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.265639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.308415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] MFA Rules not processed for user `2c1dad5cdd904b589b83eec43409d4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:40.310105 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:40.442583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1281/2559] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:40.447236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.473432 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6bf3b-eb49-422f-aae4-6d64a2f8d21c service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.572203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.572741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.573048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.573345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.574234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.577125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.615270 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1279/2560] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:40 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:40.619545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.632487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b1a1-48a5-495a-8117-032373b5637d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.691299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:40.712125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.712920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.713585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.713901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.714711 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.716789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.751150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1282/2561] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:40 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:40.752312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.764652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e71e-323d-4512-804b-3a6b3e947d8c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.770634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.771295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.771729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.771854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.772607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.774233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.787198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1280/2562] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:40.792368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.805102 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd04af-68c3-4a42-87c0-f52272fcf677 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.810491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.811178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.811521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.812012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] PATH_INFO: `/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef/users/cef9269c45574f3b970415a2e6b6d229/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.832767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430ca2d0a25d40fe936d4e56cb27e8ef, user_id=cef9269c45574f3b970415a2e6b6d229, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.835833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.861379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1283/2563] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:40 2022] PUT /identity/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef/users/cef9269c45574f3b970415a2e6b6d229/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:40.865987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:40.880057 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5098-855a-4799-a08d-3cc34ea188ac admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:40.978198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:40.979116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:40.979727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:40.980006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:40.980671 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:40.982353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b886c-5d6d-4afa-8a4f-a79068d5bfdb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:40.998894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1281/2564] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:41.007611 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:41.021262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b17d3-14a9-4c84-89f1-a574c2c259b3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:41.028920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:41.029881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:41.030351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:41.030815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] PATH_INFO: `/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef/users/cef9269c45574f3b970415a2e6b6d229/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:41.034323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430ca2d0a25d40fe936d4e56cb27e8ef, user_id=cef9269c45574f3b970415a2e6b6d229, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:41.039165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:41.064730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1284/2565] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:41 2022] PUT /identity/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef/users/cef9269c45574f3b970415a2e6b6d229/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:41.075764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:41.076258 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:41.076358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:41.115142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:41.135199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] MFA Rules not processed for user `cef9269c45574f3b970415a2e6b6d229`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:41.137190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:41.279648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1282/2566] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:41.300459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:41.382014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f15c-7434-43eb-be4d-9f44170e11a0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:41.388189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:41.388975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:41.389257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:41.389633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:41.403641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:41.405689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:41.423499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1285/2567] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:41.512297 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:41.528036 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99653960-a26b-4baa-82c9-f3f30f4adaee None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:41.535217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:41.536307 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:41.536599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:41.536879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:41.637707 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:41.640910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1071ca-2c30-45cc-aaf7-335446bea354 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:41.661344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1283/2568] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:42.161097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:42.254247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c1ed-0c00-485a-887e-9fa38102017d service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:42.260595 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:42.261317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:42.261776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:42.262114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] PATH_INFO: `/v3/users/2c1dad5cdd904b589b83eec43409d4e0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:42.263717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1dad5cdd904b589b83eec43409d4e0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:42.266610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:42.329998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:42.332926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1dad5cdd904b589b83eec43409d4e0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:42.343407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1dad5cdd904b589b83eec43409d4e0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:42.344832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1dad5cdd904b589b83eec43409d4e0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:42.364448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1dad5cdd904b589b83eec43409d4e0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:42.372719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1dad5cdd904b589b83eec43409d4e0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:42.380159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1286/2569] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:42 2022] DELETE /identity/v3/users/2c1dad5cdd904b589b83eec43409d4e0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:42.385510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:42.386161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:42.386161 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:42.406040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:42.407383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:42.485015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1284/2570] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:42.500120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:42.502321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:42.581143 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380911-201c-4031-9c27-8eb52def22ef admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:42.586205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:42.587085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:42.587556 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:42.587982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:42.602518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:42.604778 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:42.620122 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1287/2571] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:42.958854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:42.961436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:42.978679 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2126b-5747-4609-b3ee-49ca0347d208 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:42.990210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:42.990881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:42.991137 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:42.991457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] PATH_INFO: `/v3/projects/78fbae00b7844354838e638c4fca87f6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:42.992758 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fbae00b7844354838e638c4fca87f6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:42.995018 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:43.051139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:43.072391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fbae00b7844354838e638c4fca87f6', 'request_id': 'req-9fa53edb-4d91-46c0-a234-6900dcdbc00a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.084911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fbae00b7844354838e638c4fca87f6', 'request_id': 'req-9fa53edb-4d91-46c0-a234-6900dcdbc00a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.101933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fbae00b7844354838e638c4fca87f6', 'request_id': 'req-9fa53edb-4d91-46c0-a234-6900dcdbc00a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.118900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] The token cache is being invalidate because project 78fbae00b7844354838e638c4fca87f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:43.119232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.119938 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.121535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1285/2572] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:42 2022] DELETE /identity/v3/projects/78fbae00b7844354838e638c4fca87f6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:43.130822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:43.147983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad479-2520-4d30-9fff-31a4f47174b6 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:43.276374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:43.277290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:43.277633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:43.277913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] PATH_INFO: `/v3/users/cef9269c45574f3b970415a2e6b6d229` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:43.279551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef9269c45574f3b970415a2e6b6d229)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:43.284232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:43.390529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef9269c45574f3b970415a2e6b6d229'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.406842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef9269c45574f3b970415a2e6b6d229'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.409823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef9269c45574f3b970415a2e6b6d229'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.440264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:43.457680 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef9269c45574f3b970415a2e6b6d229'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.467390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-56c2ea5d-1ee8-4aa4-bdf4-186fa28c9371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef9269c45574f3b970415a2e6b6d229'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:43.475369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1288/2573] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:43 2022] DELETE /identity/v3/users/cef9269c45574f3b970415a2e6b6d229 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:43.846753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:43.848445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:43.870994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53edb-4d91-46c0-a234-6900dcdbc00a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:43.950825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:43.951394 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:43.951698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:43.951942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] PATH_INFO: `/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:43.953163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430ca2d0a25d40fe936d4e56cb27e8ef)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:43.955695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.012805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430ca2d0a25d40fe936d4e56cb27e8ef', 'request_id': 'req-58ea763c-f186-4a0f-ace1-838bd3df5d77'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:44.026293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430ca2d0a25d40fe936d4e56cb27e8ef', 'request_id': 'req-58ea763c-f186-4a0f-ace1-838bd3df5d77'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:44.045559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430ca2d0a25d40fe936d4e56cb27e8ef', 'request_id': 'req-58ea763c-f186-4a0f-ace1-838bd3df5d77'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:44.064651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] The token cache is being invalidate because project 430ca2d0a25d40fe936d4e56cb27e8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:44.064992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:44.065996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-58ea763c-f186-4a0f-ace1-838bd3df5d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:44.067779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1286/2574] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:43 2022] DELETE /identity/v3/projects/430ca2d0a25d40fe936d4e56cb27e8ef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:44.075922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.076397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.076844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.104691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:44.105971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.180218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1289/2575] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:44.191459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.192002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.192513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.225824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:44.226966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.239605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1287/2576] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:44.244880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.260080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b92dd-6351-4b16-b187-26ce40281087 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.266726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.267651 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.268127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.268608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.269876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:44.270435 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.273178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.289640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1290/2577] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:06:44.295644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.306249 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b23b58-ddb8-4121-b79c-9a1caeb0f374 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.313801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.314764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.315139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.315505 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.316319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.318824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.359305 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1288/2578] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:44 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:44.366570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.379246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddd28-73e2-4e76-9f92-403f2211c752 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.463317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.463941 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.464299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.464571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.465161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.467129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.501669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1291/2579] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:44 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:44.505328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.519071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7af4-8866-459b-8d84-449a5132f81c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.525554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.526533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.527010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.527529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.538515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.538515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.548199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1289/2580] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:44.554845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.574202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10ad7-a454-4bb0-9d6d-cffb5f5294a0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.580818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.581438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.581758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.582049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.582704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.584575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.607013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1292/2581] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:44.612622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.612874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.615390 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.624345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccb9f5-b5af-44f2-9313-9d9accc9d2e8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.630476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.632008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.632008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.632008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] PATH_INFO: `/v3/projects/df0c362359f14c5094a2f08e055ff19b/users/2d019dc5d3dd4e2189585a07a8c93d6b/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.648034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:44.663756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0c362359f14c5094a2f08e055ff19b, user_id=2d019dc5d3dd4e2189585a07a8c93d6b, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.668403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba46beb-240d-4147-8c19-97b384f4887f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.701568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1293/2582] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:44 2022] PUT /identity/v3/projects/df0c362359f14c5094a2f08e055ff19b/users/2d019dc5d3dd4e2189585a07a8c93d6b/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:44.710118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.710410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.710693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.735462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a658d5-1b94-41cb-a6b6-d6cec17ee611 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.753325 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] MFA Rules not processed for user `2d019dc5d3dd4e2189585a07a8c93d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:44.754961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.784471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:44.814186 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.815477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.815814 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.816207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:44.818262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.874956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1294/2583] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:44.889100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:44.891983 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:44.926005 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:44.928449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:44.947263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1290/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:44.988365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ee68-1cc9-4dde-ac1f-9e05823b1153 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:44.996702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:44.997775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:44.997775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:44.998093 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:45.015342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:45.018488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:45.037368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1295/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:50.144851 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:50.147201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:50.173795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4dc9-92dc-4f09-8ace-d5e762ac4ff2 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:50.181628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:50.182749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:50.183468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:50.184198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] PATH_INFO: `/v3/users/d2292379507f425aa217920f15aba22d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:50.186298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2292379507f425aa217920f15aba22d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:50.190537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:50.277362 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2292379507f425aa217920f15aba22d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.299402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2292379507f425aa217920f15aba22d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.316537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:50.318498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2292379507f425aa217920f15aba22d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.330443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2292379507f425aa217920f15aba22d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.331988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f154c0b7-d623-454b-b331-1f1b3b799bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2292379507f425aa217920f15aba22d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.339367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1291/2586] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:50 2022] DELETE /identity/v3/users/d2292379507f425aa217920f15aba22d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:50.602257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:50.621837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9649-6bac-49c3-aadf-e68514af5be3 service glance] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:50.727890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:50.728679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:50.729027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:50.729360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] PATH_INFO: `/v3/projects/92db9b9ce7d44b3596f44a6984c794d8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:50.730657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92db9b9ce7d44b3596f44a6984c794d8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:50.732756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:50.797296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92db9b9ce7d44b3596f44a6984c794d8', 'request_id': 'req-745e5018-e821-40df-a461-aa2f0a2b6237'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.804529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92db9b9ce7d44b3596f44a6984c794d8', 'request_id': 'req-745e5018-e821-40df-a461-aa2f0a2b6237'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.808959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:50.811399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92db9b9ce7d44b3596f44a6984c794d8', 'request_id': 'req-745e5018-e821-40df-a461-aa2f0a2b6237'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.826522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] The token cache is being invalidate because project 92db9b9ce7d44b3596f44a6984c794d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:50.826811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.827469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-745e5018-e821-40df-a461-aa2f0a2b6237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:50.833372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1296/2587] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:50 2022] DELETE /identity/v3/projects/92db9b9ce7d44b3596f44a6984c794d8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:50.835898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:50.836654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:50.837276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:50.872788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:50.874673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:50.950176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1292/2588] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:50.964879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:50.965273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:50.965708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:50.993132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:50.994416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:51.004101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1297/2589] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:51.009116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.019820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda7a03-db51-4cb4-9e83-0431805b0d11 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.024518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.025125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.025405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.025708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.026367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:51.026666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.028285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.043599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1293/2590] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:06:51.049249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.064523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649d03f-cfcf-4ea2-b77a-4cbed3ae2702 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.070701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.071560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.071910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.072343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.073253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.075395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.128935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1298/2591] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:51 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:51.134597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.147033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339b21-55e5-4f8f-b475-009595532a64 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.242744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.243651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.244054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.244446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.245181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.247424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.289944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1294/2592] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:51 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:51.291718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.318934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f2d0-aed9-44d0-aee9-33c55ff2d4f9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.323975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.324695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.324943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.325219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.325902 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.327572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.344220 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1299/2593] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:51.350534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.369735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9bea-09c6-4626-b981-f0c689553e8a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.377031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.377666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.377962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.378236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.378863 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.380749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7a759-0623-4a98-81e9-32d03cf7cea6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.392744 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1295/2594] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:51.397027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.408803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f152293-f750-4ca5-a992-1cc73049dc34 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.414471 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.415254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.415615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.415890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] PATH_INFO: `/v3/projects/8f3af486e2ab46b898fc141f82932184/users/b1bc010f88e6494fba9e0027d6dda5bd/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.439914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3af486e2ab46b898fc141f82932184, user_id=b1bc010f88e6494fba9e0027d6dda5bd, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.442524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.464918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1300/2595] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:51 2022] PUT /identity/v3/projects/8f3af486e2ab46b898fc141f82932184/users/b1bc010f88e6494fba9e0027d6dda5bd/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:51.483088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.483732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.484242 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.521887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] MFA Rules not processed for user `b1bc010f88e6494fba9e0027d6dda5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:51.523131 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:51.589074 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:51.629774 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1296/2596] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:51.642749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:51.646057 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:51.717932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c2cc-5aed-4392-b056-b752e227c817 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:51.723737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:51.724488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:51.724872 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:51.725174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:51.735888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:51.737365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a40d4-87d5-4585-a9ef-b9120e6735a7 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:51.747114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1301/2597] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:06:57.109451 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:57.114618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:57.208080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13eb7e-f167-4dea-ba21-9a33b41dbed7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:57.213321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:57.214004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:57.214308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:57.214584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] PATH_INFO: `/v3/users/b1eab8cfbcf5425482e9766a473404f8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:57.215830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1eab8cfbcf5425482e9766a473404f8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:57.217794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:57.285907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1eab8cfbcf5425482e9766a473404f8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:57.295615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1eab8cfbcf5425482e9766a473404f8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:57.313918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1eab8cfbcf5425482e9766a473404f8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:57.324820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1eab8cfbcf5425482e9766a473404f8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:57.325873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1eab8cfbcf5425482e9766a473404f8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:57.334990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1297/2598] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:57 2022] DELETE /identity/v3/users/b1eab8cfbcf5425482e9766a473404f8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:57.340474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:57.341168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:57.341448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:57.365175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:57.367213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:57.448848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1302/2599] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:57.462715 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:57.464232 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:57.557633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabf31-88ae-496e-8d1e-49453809b455 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:57.561885 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:57.562533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:57.562812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:57.563080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:57.573750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:57.576644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:57.591615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1298/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:06:57.935736 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:57.938857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:57.960059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9dfc-b118-44d5-bf9e-897d6ca8009d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:57.966179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:57.966906 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:57.967361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:57.967818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] PATH_INFO: `/v3/projects/d58b7042408b405aadf8c5cb584a82ab` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:57.970221 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58b7042408b405aadf8c5cb584a82ab)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:57.973184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:58.002422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:58.032178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58b7042408b405aadf8c5cb584a82ab', 'request_id': 'req-749d09a6-4276-4dfb-be54-fe28d6e07fd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.040170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58b7042408b405aadf8c5cb584a82ab', 'request_id': 'req-749d09a6-4276-4dfb-be54-fe28d6e07fd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.048718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58b7042408b405aadf8c5cb584a82ab', 'request_id': 'req-749d09a6-4276-4dfb-be54-fe28d6e07fd1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.063959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] The token cache is being invalidate because project d58b7042408b405aadf8c5cb584a82ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:58.063959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.065217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.066588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1303/2601] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:57 2022] DELETE /identity/v3/projects/d58b7042408b405aadf8c5cb584a82ab => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:58.070694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:58.077174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:58.084954 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab915-3357-4a98-b2d5-5eb42a421f7d service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:58.166605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:58.167627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.167627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.167810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] PATH_INFO: `/v3/users/d23942bf74da4be086aa21334636623d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.168893 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23942bf74da4be086aa21334636623d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:58.170846 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:58.222410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23942bf74da4be086aa21334636623d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.232775 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23942bf74da4be086aa21334636623d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.251078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23942bf74da4be086aa21334636623d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.259383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23942bf74da4be086aa21334636623d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.260121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c65bbff0-4209-46c5-8d76-9df737f0f689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23942bf74da4be086aa21334636623d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.266269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1299/2602] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:06:58 2022] DELETE /identity/v3/users/d23942bf74da4be086aa21334636623d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:58.578957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:58.581294 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:58.598841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d09a6-4276-4dfb-be54-fe28d6e07fd1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:58.680879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:58.681589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.681860 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.682131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] PATH_INFO: `/v3/projects/8244685bdca24064b858e1f2b642e74e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.683321 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8244685bdca24064b858e1f2b642e74e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:58.685231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:58.752144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8244685bdca24064b858e1f2b642e74e', 'request_id': 'req-6367c0b0-f875-417d-92bc-2eacd744fb74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.760025 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8244685bdca24064b858e1f2b642e74e', 'request_id': 'req-6367c0b0-f875-417d-92bc-2eacd744fb74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.769787 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8244685bdca24064b858e1f2b642e74e', 'request_id': 'req-6367c0b0-f875-417d-92bc-2eacd744fb74'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.784400 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] The token cache is being invalidate because project 8244685bdca24064b858e1f2b642e74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:06:58.784694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.785355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6367c0b0-f875-417d-92bc-2eacd744fb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:06:58.787155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1304/2603] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:06:58 2022] DELETE /identity/v3/projects/8244685bdca24064b858e1f2b642e74e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:58.794710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.794987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.796388 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.820956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:58.822235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:58.887748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1300/2604] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:58.897706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.897993 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.898268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.918499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:58.919701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:58.929804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1305/2605] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:06:58.934128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:58.944705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5414e-fd6d-438b-a871-a927ce652dd8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:58.949269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:58.949887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.950163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.950426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.951063 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:06:58.951359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:58.953096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:58.964490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1301/2606] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:06:58.969005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:58.978508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a99c51-9eaf-4722-8927-ef4bcf034281 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:58.983261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:58.984417 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:58.984760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:58.985034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:58.985701 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:58.987628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.017573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1306/2607] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:58 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:59.025655 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.041098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36196f8e-349a-49ee-8b98-fa1272936951 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.051178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:59.104243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.104849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.105126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.105450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.106363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.108260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.133858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1302/2608] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:59 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:06:59.138442 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.150493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d4432-2955-4aa4-9a5f-e5ac4a93787a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.156058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.156764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.157239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.157547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.158198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.160055 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.166422 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:59.172473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1307/2609] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:59.177177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.189622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb406fe-34b2-434c-864d-276e4e1daa15 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.195280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.195717 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.196383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.196383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.197443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.198652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7cbd7-f78a-4d6b-bd68-7567e03bb9f2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.212446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1303/2610] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:59.218925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.231863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2c7c-c859-498c-ac92-22655530e768 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.237913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.238570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.238856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.239127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] PATH_INFO: `/v3/projects/5fc919c111d44e2a96c9dc818f2ddbcd/users/a3dce0e816264f5b8744aaebb79ff80e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.257725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc919c111d44e2a96c9dc818f2ddbcd, user_id=a3dce0e816264f5b8744aaebb79ff80e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.260356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.275861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1308/2611] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:59 2022] PUT /identity/v3/projects/5fc919c111d44e2a96c9dc818f2ddbcd/users/a3dce0e816264f5b8744aaebb79ff80e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:06:59.287071 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.287363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.287634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.318047 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] MFA Rules not processed for user `a3dce0e816264f5b8744aaebb79ff80e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:59.319282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:06:59.393164 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1304/2612] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:06:59.398193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.466673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d55e-cb65-405b-ad39-23a0a6140942 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.473245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.473885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.474166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.474439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.475092 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.477037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.505097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1309/2613] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:06:59 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:59.509533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.520447 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1978e-ab19-4120-acd8-838aadc82d53 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.582025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.582544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.582823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.583095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.583725 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.585782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.608607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1305/2614] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:06:59 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:06:59.620567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.636705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc962a-2fb0-4fb6-9864-9219070e3891 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.642387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.643005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.643285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.643588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.644237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.645918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.659361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1310/2615] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:06:59.663612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.677801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b102b6e-5e09-4477-8738-ec54a73f513f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.685562 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.687142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.687855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.688330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] PATH_INFO: `/v3/projects/9c714bd66e4f41ceac8d8093df541dda/users/032c1d951fe64316889c543fc4f67a6f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.697361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:59.716661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c714bd66e4f41ceac8d8093df541dda, user_id=032c1d951fe64316889c543fc4f67a6f, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.722544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.742306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1306/2616] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:59 2022] PUT /identity/v3/projects/9c714bd66e4f41ceac8d8093df541dda/users/032c1d951fe64316889c543fc4f67a6f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:59.747068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.758203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e2f-2294-424d-af77-71de40fce3e8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.832931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.833750 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.834214 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.837970 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.838749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.840534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aea935-e636-42d6-a23c-1caf2cdafc94 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.856826 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1311/2617] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:06:59.861697 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:06:59.881832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9767d-2cfd-4eae-ae59-a1ce793bb948 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:06:59.892419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:06:59.893220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.893596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.893937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] PATH_INFO: `/v3/projects/9c714bd66e4f41ceac8d8093df541dda/users/032c1d951fe64316889c543fc4f67a6f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.896554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c714bd66e4f41ceac8d8093df541dda, user_id=032c1d951fe64316889c543fc4f67a6f, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:06:59.899446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:06:59.914635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1307/2618] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:06:59 2022] PUT /identity/v3/projects/9c714bd66e4f41ceac8d8093df541dda/users/032c1d951fe64316889c543fc4f67a6f/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:06:59.928641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:06:59.929003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:06:59.929462 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:06:59.970056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] MFA Rules not processed for user `032c1d951fe64316889c543fc4f67a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:06:59.971380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:00.020015 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:00.084584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1312/2619] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:00.097827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:00.101764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:00.191276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e0a9-ea80-4e66-b9d2-60fcbc537b82 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:00.196033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:00.196468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:00.196781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:00.197053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:00.206928 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:00.208395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230759c-8755-4244-8a25-73d0bd46b061 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:00.219682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1308/2620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:00.271420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:00.354332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ed3ea-4665-477b-9a41-1e151c9157cc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:00.361476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:00.361476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:00.361894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:00.362366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] PATH_INFO: `/v3/users/a3dce0e816264f5b8744aaebb79ff80e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:00.363801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dce0e816264f5b8744aaebb79ff80e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:00.366075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:00.419881 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dce0e816264f5b8744aaebb79ff80e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:00.430396 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dce0e816264f5b8744aaebb79ff80e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:00.431271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dce0e816264f5b8744aaebb79ff80e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:00.452337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dce0e816264f5b8744aaebb79ff80e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:00.459614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dce0e816264f5b8744aaebb79ff80e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:00.465625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1313/2621] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:00 2022] DELETE /identity/v3/users/a3dce0e816264f5b8744aaebb79ff80e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:00.470619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:00.470927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:00.471201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:00.492034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:00.493265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:00.565321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1309/2622] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:00.575390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:00.576835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:00.639513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eda8-7999-4b46-80c9-609b63cf7480 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:00.644579 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:00.645640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:00.646109 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:00.646584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:00.654204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:00.659067 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:00.660879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:00.679261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1314/2623] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:00.956995 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:00.958539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:00.971685 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70a8cb-97a2-4744-8450-4f8fa5cbeb54 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:00.978102 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:00.978755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:00.979116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:00.979443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] PATH_INFO: `/v3/users/b1bc010f88e6494fba9e0027d6dda5bd` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:00.980733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bc010f88e6494fba9e0027d6dda5bd)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:00.982737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:00.988714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:00.990481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.010789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984acc25-53e8-42ae-9a0c-f09037101a12 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.017241 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.017791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.018202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.019228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] PATH_INFO: `/v3/projects/5fc919c111d44e2a96c9dc818f2ddbcd` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.019880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc919c111d44e2a96c9dc818f2ddbcd)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.022426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.066800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bc010f88e6494fba9e0027d6dda5bd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.075015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bc010f88e6494fba9e0027d6dda5bd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.099150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc919c111d44e2a96c9dc818f2ddbcd', 'request_id': 'req-4ab31dae-88cf-4de6-8f25-494d20a31bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.100328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.103653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bc010f88e6494fba9e0027d6dda5bd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.111497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc919c111d44e2a96c9dc818f2ddbcd', 'request_id': 'req-4ab31dae-88cf-4de6-8f25-494d20a31bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.119476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bc010f88e6494fba9e0027d6dda5bd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.120088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc919c111d44e2a96c9dc818f2ddbcd', 'request_id': 'req-4ab31dae-88cf-4de6-8f25-494d20a31bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.127806 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-10b720bc-3781-422c-adf0-e9b091f6c1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bc010f88e6494fba9e0027d6dda5bd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.135511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] The token cache is being invalidate because project 5fc919c111d44e2a96c9dc818f2ddbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:01.135751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1310/2624] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:00 2022] DELETE /identity/v3/users/b1bc010f88e6494fba9e0027d6dda5bd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:01.135844 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.136525 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.138088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1315/2625] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:00 2022] DELETE /identity/v3/projects/5fc919c111d44e2a96c9dc818f2ddbcd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:01.141235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.141235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.141235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.144412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.145845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.167684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:01.168811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.222628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31dae-88cf-4de6-8f25-494d20a31bd5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.232810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1311/2626] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:01.244069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.246138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.292370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.293049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.293329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.293708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] PATH_INFO: `/v3/users/032c1d951fe64316889c543fc4f67a6f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.294942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=032c1d951fe64316889c543fc4f67a6f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.297974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.320564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ff0f-4fdd-4a13-8708-dede11592943 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.324720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.325330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.325830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.326124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.334831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.337215 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.338682 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.353627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1312/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:01.354792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.356732 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.362483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032c1d951fe64316889c543fc4f67a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.373933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032c1d951fe64316889c543fc4f67a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.375632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032c1d951fe64316889c543fc4f67a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.376532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa1a4-00ed-43e9-9617-2cc11d7703f8 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.382964 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.383771 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.384116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.384427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] PATH_INFO: `/v3/users/2d019dc5d3dd4e2189585a07a8c93d6b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.386007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d019dc5d3dd4e2189585a07a8c93d6b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.388830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.396352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032c1d951fe64316889c543fc4f67a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.407188 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb899b7-89c2-4f36-9b6e-eafc5fb0a4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032c1d951fe64316889c543fc4f67a6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.416104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1316/2628] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:01 2022] DELETE /identity/v3/users/032c1d951fe64316889c543fc4f67a6f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:01.454282 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d019dc5d3dd4e2189585a07a8c93d6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.462475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d019dc5d3dd4e2189585a07a8c93d6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.477058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d019dc5d3dd4e2189585a07a8c93d6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.485675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d019dc5d3dd4e2189585a07a8c93d6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.486716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d019dc5d3dd4e2189585a07a8c93d6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.493894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1313/2629] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:01 2022] DELETE /identity/v3/users/2d019dc5d3dd4e2189585a07a8c93d6b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:01.499182 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.499559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.499959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.522585 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:01.523854 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.610348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1317/2630] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:01.619918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.622426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.629801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.705223 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27cab8-a491-45ad-8eaf-075df5a2831f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.709454 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.709833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.710678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.710678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.720572 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.722052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.733285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1314/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:01.795591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.798452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.811580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc848d-cccf-461e-9da2-99b8dbb17c88 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.818248 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.818972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.819261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.819538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] PATH_INFO: `/v3/projects/8f3af486e2ab46b898fc141f82932184` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.820920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3af486e2ab46b898fc141f82932184)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.822891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.835594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:01.837101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.865243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b86d-5177-4b91-abe8-79243b8e7811 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:01.878544 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:01.880513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.881203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.881772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] PATH_INFO: `/v3/projects/9c714bd66e4f41ceac8d8093df541dda` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.883268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c714bd66e4f41ceac8d8093df541dda)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:01.885849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:01.898035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3af486e2ab46b898fc141f82932184', 'request_id': 'req-c0607abf-e701-4c27-bd02-e3a45886e3eb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.907434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3af486e2ab46b898fc141f82932184', 'request_id': 'req-c0607abf-e701-4c27-bd02-e3a45886e3eb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.914888 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3af486e2ab46b898fc141f82932184', 'request_id': 'req-c0607abf-e701-4c27-bd02-e3a45886e3eb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.931256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] The token cache is being invalidate because project 8f3af486e2ab46b898fc141f82932184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:01.931483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.932041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0607abf-e701-4c27-bd02-e3a45886e3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.934004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1318/2632] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:01 2022] DELETE /identity/v3/projects/8f3af486e2ab46b898fc141f82932184 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:01.940161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69da42-5945-4d24-a128-6df59ccd6fd4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:01.940365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69da42-5945-4d24-a128-6df59ccd6fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:01.940640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69da42-5945-4d24-a128-6df59ccd6fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:01.955510 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c714bd66e4f41ceac8d8093df541dda', 'request_id': 'req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.970766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ae69da42-5945-4d24-a128-6df59ccd6fd4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:01.972013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ae69da42-5945-4d24-a128-6df59ccd6fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:01.973843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c714bd66e4f41ceac8d8093df541dda', 'request_id': 'req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.980564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c714bd66e4f41ceac8d8093df541dda', 'request_id': 'req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:01.997534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:02.001355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] The token cache is being invalidate because project 9c714bd66e4f41ceac8d8093df541dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:02.001355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.004466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a9d68a4a-ee66-47a1-ab7f-2a3ec3938c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.009598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1315/2633] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:01 2022] DELETE /identity/v3/projects/9c714bd66e4f41ceac8d8093df541dda => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:02.013889 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.014330 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.014728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.038238 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.039554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.058358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1319/2634] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:02.066446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.066770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.067007 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.089372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.090672 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.114094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1320/2635] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:02.115946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.117679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.119858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1316/2636] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:02.121059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.131794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591022e8-edca-42d7-b6b7-c5678d09b044 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.133438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7e7e-79f7-49c8-b220-a0700a863219 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.138468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.138959 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.139109 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.139254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.139501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.139616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.139904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.140407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:02.140949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.141243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] PATH_INFO: `/v3/projects/df0c362359f14c5094a2f08e055ff19b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.142751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0c362359f14c5094a2f08e055ff19b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.144730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.151807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158af0-5e3e-4c52-984b-6dc0da80a2ee admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.170140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1317/2637] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:02.170140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dec33-1103-4310-af0c-c96869620226 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.170140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dec33-1103-4310-af0c-c96869620226 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.170140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dec33-1103-4310-af0c-c96869620226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.191973 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2c0dec33-1103-4310-af0c-c96869620226 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.193103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2c0dec33-1103-4310-af0c-c96869620226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.201861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0c362359f14c5094a2f08e055ff19b', 'request_id': 'req-cf6ab23f-2559-4e8f-a527-951d08ed61f3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.204532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:02.209545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0c362359f14c5094a2f08e055ff19b', 'request_id': 'req-cf6ab23f-2559-4e8f-a527-951d08ed61f3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.216075 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0c362359f14c5094a2f08e055ff19b', 'request_id': 'req-cf6ab23f-2559-4e8f-a527-951d08ed61f3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.229529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] The token cache is being invalidate because project df0c362359f14c5094a2f08e055ff19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:02.229825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.230502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:02.232024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1321/2638] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:02 2022] DELETE /identity/v3/projects/df0c362359f14c5094a2f08e055ff19b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:02.232760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.235346 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.270405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1318/2639] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:02.271663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.271951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.272229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.294285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.295500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.304549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1319/2640] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:02.305353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.320682 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ab23f-2559-4e8f-a527-951d08ed61f3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.322195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46bf2f-736f-4c2d-bd0a-cd46af7f6bae None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.325798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.326413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.326681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.326952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.327114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.328148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.328342 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.329022 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.329298 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.329986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:02.330285 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.330474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.331878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70958ad-d0e2-4efa-ab98-3de60a2fd646 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.352925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1320/2641] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:02.352925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.352925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.352925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.366420 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1322/2642] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.367242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.377112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.379412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:02.408753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:02.450052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d7f06-44f4-44a9-aec1-667f2464af01 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.455360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.456001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.456286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.456563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.457234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.459230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.498568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1323/2643] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.498568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.574205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1321/2644] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:02.575040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.582527 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dd098-e805-41fe-9721-dbb6af86833f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.586076 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0293390-6c38-4421-b5a4-f2d0eaad1baf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.587142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.587746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.588024 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.588296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.588980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.590797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.590979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.591500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.591778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.592045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.592664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.594960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.618446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1324/2645] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.618446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.618741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1322/2646] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.619403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.630312 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e385ab-5706-4438-8079-71ee3d57ac47 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.630608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ce3-e155-4a01-a967-62ba5d11bb53 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.635809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.636412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.636645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.636764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.636949 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.637247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.637567 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.637684 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:02.637844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.637995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.638494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.639489 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.640529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.652065 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1323/2647] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:02.653912 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1325/2648] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:02.654919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.658161 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.665445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e226dc-27b4-4f26-83ea-cc8425c8f33b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.668548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30659-19a0-43c7-83dd-d6e3f7e257b9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.670474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.671053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.672025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.672410 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.673048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.674114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.674634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.674766 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.674961 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.675234 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.675870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.677429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.688033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1324/2649] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:02.689117 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.693555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1326/2650] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:02.695650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.699657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f40b-60e4-400a-9b57-823b4b7e9208 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.705113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.705670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.705952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.706120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a68e0-b512-49b8-8eea-a41f71848b76 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.706284 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.706830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.708700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.710999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.711553 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.711966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.712193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.712783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.714452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.724639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1327/2651] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:02.725818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.740360 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735752e-1a53-466b-8360-2dc48575f101 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.742632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1325/2652] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.748075 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.751359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.752485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.752975 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.754152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] PATH_INFO: `/v3/projects/f739ca41c224410280585c6bc7aef95b/users/38893febe24540ea8bca5b4121e7cec2/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.770734 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f739ca41c224410280585c6bc7aef95b, user_id=38893febe24540ea8bca5b4121e7cec2, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.773625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.790003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1328/2653] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:02 2022] PUT /identity/v3/projects/f739ca41c224410280585c6bc7aef95b/users/38893febe24540ea8bca5b4121e7cec2/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:02.791468 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.797272 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:02.828051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040516-f522-4577-b373-3dd7d61e3f3c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.875065 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:02.895899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91132-d256-424b-8927-ae118679cd32 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:02.899641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.901020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.901020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.901306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:02.901469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] PATH_INFO: `/v3/projects/5865a8f183e54e7a972ca8b383e1810a/users/223a21592ca04671a35f6d0c68484c10/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.901674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.901875 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.902150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.902903 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.904719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2a7cf-c16d-46f1-989f-47150f6597d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.919677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5865a8f183e54e7a972ca8b383e1810a, user_id=223a21592ca04671a35f6d0c68484c10, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:02.923560 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:02.930334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1329/2654] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:02.931614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:02.931892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:02.932159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:02.940768 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1326/2655] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:02 2022] PUT /identity/v3/projects/5865a8f183e54e7a972ca8b383e1810a/users/223a21592ca04671a35f6d0c68484c10/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:02.941667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:02.973423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] MFA Rules not processed for user `38893febe24540ea8bca5b4121e7cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:02.974673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:03.021179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d2a2-01a4-4e77-9396-146444b90fca admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.026290 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.026898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.027176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.027441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.028088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.029711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659294-ba79-48c6-a77b-4c90c111e688 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.040979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1327/2656] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.042250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.042530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.042799 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.071033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1330/2657] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:03.072423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] MFA Rules not processed for user `223a21592ca04671a35f6d0c68484c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:03.073681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:03.074865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.092812 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ab55c-2a5d-4752-96a8-a77b8a11077a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.098168 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.099002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.099271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.099539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.100183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.101839 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.114376 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1331/2658] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.115218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.125561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6577eb-675f-47b5-a99e-705d29aeb254 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.130351 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.130967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.131398 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.131508 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.132140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.134128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.134879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:03.159767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1328/2659] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:03.160593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.168042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1332/2660] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.168042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.171002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e979-cd55-4e7e-baa7-d7892faab5b5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.237812 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.238383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.238661 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.238985 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] PATH_INFO: `/v3/projects/72c7d0fd730e4f14b8de1bacc6a3c58a/users/cde14c40977d4343962a082c67fed43b/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.244426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ee696-7001-4db9-9a13-b3705367ccf5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.249240 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.249944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.250218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.250498 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.251136 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.253068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86a2c2-2838-45f5-95ce-17b47647d2f3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.254489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c7d0fd730e4f14b8de1bacc6a3c58a, user_id=cde14c40977d4343962a082c67fed43b, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.257124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.270878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1329/2661] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:03 2022] PUT /identity/v3/projects/72c7d0fd730e4f14b8de1bacc6a3c58a/users/cde14c40977d4343962a082c67fed43b/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:03.271673 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.297776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1333/2662] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.297776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.297776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.297776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.331192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] MFA Rules not processed for user `cde14c40977d4343962a082c67fed43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:03.332436 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:03.337142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:03.353050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a09bd1-a80b-47c6-bd40-e3d3946312bd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.414303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1334/2663] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:03.415357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.426916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.427523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.427800 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.428068 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.428700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.430622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.458866 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1330/2664] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.459632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.470895 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061894-9ba0-4924-b121-5d4b76b8f717 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.476140 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.476755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.477027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.477456 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.478129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.480013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.492392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:03.496980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91620-24c3-44ef-b6ad-5f8d6f84e0d8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.504943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.505617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.505894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.506178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.506815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.508786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.512180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1331/2665] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.513015 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.537056 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1335/2666] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.538439 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.552519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a95c8f-150c-4018-a7dc-4b368b415b0b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.592359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc2351-2337-4fd0-ac73-f61ecfffae5f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.598996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.599612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.599897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.600170 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.600930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.602529 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.622487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.622793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1332/2667] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.623550 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.623756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.623936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.624337 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.625600 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.627590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.640891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196c79-d938-423f-a08a-03f47b2a65b6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.646584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.647250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.647531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.647805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.648452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.650084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.653807 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1336/2668] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:03 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:03.654584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.665797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1333/2669] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.666627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.667366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7dd34-7971-42d0-b86e-d7db48ad76db admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.678269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4043-5683-4630-afb3-cb9beaed5ce5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.681267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.682288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.682570 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.682842 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] PATH_INFO: `/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b/users/f52c53468a8f4cbaa6036462bd0866ce/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.683364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.683944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.684225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.684500 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.685138 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.687516 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.700811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed67dbdc2ffe4d2aaa5d22f370be0b2b, user_id=f52c53468a8f4cbaa6036462bd0866ce, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.702197 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1334/2670] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.703053 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.704118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.714121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:03.714735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ab99-444f-4bc0-93a2-e8de52b307b1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.720042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1337/2671] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:03 2022] PUT /identity/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b/users/f52c53468a8f4cbaa6036462bd0866ce/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:03.721528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.774592 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.775149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.775433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.775711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] PATH_INFO: `/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224/users/9235995cf5ad488d9ca3251c6d7e00d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.787117 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fef5-3168-42ac-9d9f-01a0d601fa97 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.791903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0aecb5ebe845c2aaaa4a251b45d224, user_id=9235995cf5ad488d9ca3251c6d7e00d3, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.792369 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.792974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.793242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.793540 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.794181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.794596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.795730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.808712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1338/2672] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.810050 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1335/2673] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:03 2022] PUT /identity/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224/users/9235995cf5ad488d9ca3251c6d7e00d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:03.813385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.813648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.823998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198ed1-4c67-4721-ab0f-c42b38f2ec39 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.864927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:03.880987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4f4e8-0a5d-41d0-a92f-9dd91f6989fa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.886310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.887100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.887539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.887913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] PATH_INFO: `/v3/projects/05d93c51f77c40f9867090737c30f3b8/users/87e4dd7941494b6bad4502c9eaa5b892/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.892668 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.893276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.893590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.893871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.894519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.896128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.904169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d93c51f77c40f9867090737c30f3b8, user_id=87e4dd7941494b6bad4502c9eaa5b892, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.907667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:03.907921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1339/2674] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:03.909020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.919628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df21921-8fd3-43d2-a64e-5a28bc567d56 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:03.921907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1336/2675] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:03 2022] PUT /identity/v3/projects/05d93c51f77c40f9867090737c30f3b8/users/87e4dd7941494b6bad4502c9eaa5b892/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:03.926323 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:03.993324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:03.994002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:03.994286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:03.994560 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:03.995213 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:03.996814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa193d0-ed19-44d6-a391-550581c81db2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.000058 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1e76-9123-4f19-b3bc-9f24ccf60d44 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.005128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.005843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.006120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.006387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] PATH_INFO: `/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b/users/f52c53468a8f4cbaa6036462bd0866ce/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.007782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1340/2676] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:04.008686 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed67dbdc2ffe4d2aaa5d22f370be0b2b, user_id=f52c53468a8f4cbaa6036462bd0866ce, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.009000 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336db3f-6669-4961-818f-431445cb6d19 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.009286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336db3f-6669-4961-818f-431445cb6d19 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.009673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336db3f-6669-4961-818f-431445cb6d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.011821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.023413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1337/2677] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:03 2022] PUT /identity/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b/users/f52c53468a8f4cbaa6036462bd0866ce/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:04.024280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.049502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5336db3f-6669-4961-818f-431445cb6d19 None None] MFA Rules not processed for user `87e4dd7941494b6bad4502c9eaa5b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:04.050710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5336db3f-6669-4961-818f-431445cb6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.069647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:04.098334 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296243-046e-4f32-8c87-abcf02e65a35 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.103654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.104338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.104619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.104886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] PATH_INFO: `/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224/users/9235995cf5ad488d9ca3251c6d7e00d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.106911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0aecb5ebe845c2aaaa4a251b45d224, user_id=9235995cf5ad488d9ca3251c6d7e00d3, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.110403 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565d81d-02a7-44df-9c22-1ee780c4a978 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.126408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1338/2678] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:04 2022] PUT /identity/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224/users/9235995cf5ad488d9ca3251c6d7e00d3/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:04.134401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.134942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.135354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.136286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1341/2679] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:04.141378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.141728 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.142005 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.167847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] MFA Rules not processed for user `f52c53468a8f4cbaa6036462bd0866ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:04.169742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.182624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] MFA Rules not processed for user `9235995cf5ad488d9ca3251c6d7e00d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:04.184296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.219324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:04.247553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1339/2680] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:04.248386 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.274301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1342/2681] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:04.275803 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.276741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.327874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d40b97-b138-41b5-9e65-a02742a3a556 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.332407 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.333006 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.333287 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.333595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.334374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.336960 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.353688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f2e1-8864-450e-8df7-e2af9ea5aab6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.357532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.358273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.359103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.359677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.371551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1340/2682] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:04.372436 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.373956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.375086 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.376788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.389641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1343/2683] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:04.391379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.406029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdbb8f-e3cc-4849-9110-0f669de54d8c service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.460277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74735b-df2d-4bfb-a354-a6926dc94732 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.465441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.466135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.466395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.466648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.467615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:04.490129 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.490911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.491187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.491460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.492496 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.494650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.526382 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1344/2684] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:04.527619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.540608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3762-b3c4-4249-8d90-da4592715286 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.547064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.547612 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.547716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.547716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.547898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.548408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.559663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1341/2685] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:04.560710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.572844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310423-2ed1-4ae6-b3ce-a6201bbdbfdf service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.581383 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.582273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.582739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.583260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.584327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.587453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.602563 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1342/2686] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:04.610365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.622855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cfc97-8fda-4e38-9d6d-b34c89a13625 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.630894 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.631820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.632322 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.632762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] PATH_INFO: `/v3/projects/6fbc18c843ff459ba60198ed56cfaec7/users/86096737de8e467591f339b0410e2272/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.636695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.637453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:04.638419 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.653681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1345/2687] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:04.655977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbc18c843ff459ba60198ed56cfaec7, user_id=86096737de8e467591f339b0410e2272, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.659019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.679910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1343/2688] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:04 2022] PUT /identity/v3/projects/6fbc18c843ff459ba60198ed56cfaec7/users/86096737de8e467591f339b0410e2272/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:04.684386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.701558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671051-66b2-4681-a7f9-cf5893a928b4 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.766379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.767083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.767453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.767783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.768444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.770108 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2141e-429c-4271-a46b-090df704cb9a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.780699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1346/2689] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:04.785247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.804452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063972b4-dd6d-4193-9d17-2c726bda96b6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:04.811029 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:04.812847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.813784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.814425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] PATH_INFO: `/v3/projects/6fbc18c843ff459ba60198ed56cfaec7/users/86096737de8e467591f339b0410e2272/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.817645 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbc18c843ff459ba60198ed56cfaec7, user_id=86096737de8e467591f339b0410e2272, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:04.820929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:04.834513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1344/2690] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:04 2022] PUT /identity/v3/projects/6fbc18c843ff459ba60198ed56cfaec7/users/86096737de8e467591f339b0410e2272/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:04.845332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:04.845841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:04.846198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:04.885085 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] MFA Rules not processed for user `86096737de8e467591f339b0410e2272`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:04.886744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:04.950578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:04.963042 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1347/2691] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:04.970205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:04.981081 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.045336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06383d87-d5a2-4c39-9c01-5f6fba604a18 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.045632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cfb2-b994-4c23-8fa8-9ce68c916c5a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.050239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.050691 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.050978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.051268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.051450 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9235995cf5ad488d9ca3251c6d7e00d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.052695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.052695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.053012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.053627 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:05.053981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.055630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.070711 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1345/2692] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:05.075420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.085761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15b22e-0a73-4876-a085-213e4d50aef5 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.090360 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9235995cf5ad488d9ca3251c6d7e00d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.090952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.091230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.091501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.092127 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.094072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.122653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1346/2693] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:05 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:05.123132 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.125243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.128135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.137363 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1348/2694] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:05.200651 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847db1a-297d-4c3c-98f4-492ee1a2b0d9 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.205999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9235995cf5ad488d9ca3251c6d7e00d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.206601 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.206886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.207160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.207984 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:05.208292 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.210067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.224418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1347/2695] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:05.267989 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.282008 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978d57-c6c2-494d-8818-b2a191d2c6b1 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.292818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9235995cf5ad488d9ca3251c6d7e00d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.293733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.294181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.294591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] PATH_INFO: `/v3/projects/a24f3d38a4ad4e45a41d31d493a08748` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.296087 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a24f3d38a4ad4e45a41d31d493a08748)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.299012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.361477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24f3d38a4ad4e45a41d31d493a08748', 'request_id': 'req-b19a60dd-ba87-42dc-8999-cedaa4497cfb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.369403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24f3d38a4ad4e45a41d31d493a08748', 'request_id': 'req-b19a60dd-ba87-42dc-8999-cedaa4497cfb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.376402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24f3d38a4ad4e45a41d31d493a08748', 'request_id': 'req-b19a60dd-ba87-42dc-8999-cedaa4497cfb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.389379 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] The token cache is being invalidate because project a24f3d38a4ad4e45a41d31d493a08748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:05.389769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.390626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b19a60dd-ba87-42dc-8999-cedaa4497cfb tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.392434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1349/2696] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:05 2022] DELETE /identity/v3/projects/a24f3d38a4ad4e45a41d31d493a08748 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:05.644593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.646503 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:05.695554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:05.725899 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9e88-816f-47f7-984e-e49d81729385 tempest-VolumeQuotaClassesTest-296538816 tempest-VolumeQuotaClassesTest-296538816-project-admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:05.786616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:05.787239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.787517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.787789 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] PATH_INFO: `/v3/users/223a21592ca04671a35f6d0c68484c10` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.788913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=223a21592ca04671a35f6d0c68484c10)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:05.790837 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:05.840999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223a21592ca04671a35f6d0c68484c10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.850333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223a21592ca04671a35f6d0c68484c10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.863346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223a21592ca04671a35f6d0c68484c10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.870475 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223a21592ca04671a35f6d0c68484c10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.871122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223a21592ca04671a35f6d0c68484c10'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:05.882605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1348/2697] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:05 2022] DELETE /identity/v3/users/223a21592ca04671a35f6d0c68484c10 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:05.887264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:05.887608 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:05.887929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:05.910226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:05.911607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:05.944774 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:05.983865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1350/2698] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:05.993453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:05.995146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:06.059794 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9fbdb-a787-43be-b683-e0fe34a12faa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:06.065896 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:06.066792 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:06.067206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:06.067617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:06.080523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:06.082853 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:06.100343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1349/2699] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:06.443998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:06.445956 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:06.465710 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268905-ba70-44ec-85a5-23ace2cb0554 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:06.473069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:06.474039 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:06.475395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:06.475395 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] PATH_INFO: `/v3/projects/5865a8f183e54e7a972ca8b383e1810a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:06.476905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5865a8f183e54e7a972ca8b383e1810a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:06.477625 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:06.548110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5865a8f183e54e7a972ca8b383e1810a', 'request_id': 'req-9360b3ac-60ec-4abb-9bae-31f190681e95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.556698 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5865a8f183e54e7a972ca8b383e1810a', 'request_id': 'req-9360b3ac-60ec-4abb-9bae-31f190681e95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.561545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5865a8f183e54e7a972ca8b383e1810a', 'request_id': 'req-9360b3ac-60ec-4abb-9bae-31f190681e95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.577889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] The token cache is being invalidate because project 5865a8f183e54e7a972ca8b383e1810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:06.578876 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.579054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.580683 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1351/2700] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:06 2022] DELETE /identity/v3/projects/5865a8f183e54e7a972ca8b383e1810a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:06.592419 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:06.599321 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:06.604213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1530-2c35-4df5-930d-5acadbe7cfa4 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:06.679134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:06.679729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:06.680073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:06.680184 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] PATH_INFO: `/v3/users/9235995cf5ad488d9ca3251c6d7e00d3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:06.681332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9235995cf5ad488d9ca3251c6d7e00d3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:06.683269 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:06.702453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:06.704262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:06.750986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9235995cf5ad488d9ca3251c6d7e00d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.759259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9235995cf5ad488d9ca3251c6d7e00d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.772532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9235995cf5ad488d9ca3251c6d7e00d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.776741 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b3ac-60ec-4abb-9bae-31f190681e95 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:06.779708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9235995cf5ad488d9ca3251c6d7e00d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.781044 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9235995cf5ad488d9ca3251c6d7e00d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:06.783126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:06.784478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:06.784985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:06.785497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:06.787630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1350/2701] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:06 2022] DELETE /identity/v3/users/9235995cf5ad488d9ca3251c6d7e00d3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:06.790254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:06.861972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:06.863494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2baca8-ee20-4bb1-aedf-25e7b897350c service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:06.876372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1352/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:07.100635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.111809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.200522 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e1e11-952c-48d3-99af-13cf5987bc61 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.212791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.213594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.213874 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.214145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] PATH_INFO: `/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.215313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0aecb5ebe845c2aaaa4a251b45d224)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.217217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.253399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:07.275852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'request_id': 'req-013a38bf-121d-4d01-bc12-47cdf5dbeffa'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.285413 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'request_id': 'req-013a38bf-121d-4d01-bc12-47cdf5dbeffa'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.292132 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0aecb5ebe845c2aaaa4a251b45d224', 'request_id': 'req-013a38bf-121d-4d01-bc12-47cdf5dbeffa'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.302918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] The token cache is being invalidate because project ad0aecb5ebe845c2aaaa4a251b45d224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:07.303210 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.304208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-013a38bf-121d-4d01-bc12-47cdf5dbeffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.305843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1351/2703] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:07 2022] DELETE /identity/v3/projects/ad0aecb5ebe845c2aaaa4a251b45d224 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:07.311618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.312315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.312315 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.333618 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:07.334843 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.340662 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:07.404576 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1353/2704] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:07.413920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.414212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.414478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.438380 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:07.439659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.449733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1352/2705] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:07.455138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.471071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bd0a6-3dcc-4a12-b3c0-866bf26fc324 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.477678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.478739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.479239 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.479635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.480788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:07.480788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.482273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.504343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1354/2706] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:07:07.506092 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.507473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.509896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.520333 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac150c3-06e4-433f-b9cd-7aee1243b53f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.525433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.526149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.526533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.526723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9591a-4ba9-468d-a23e-30d26a7ff00e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.526927 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.527626 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.529726 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.531428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.532053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.532336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.532614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] PATH_INFO: `/v3/users/38893febe24540ea8bca5b4121e7cec2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.534033 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38893febe24540ea8bca5b4121e7cec2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.536104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.558720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1353/2707] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:07.560039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.563777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.589547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38893febe24540ea8bca5b4121e7cec2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.598646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38893febe24540ea8bca5b4121e7cec2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.599274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38893febe24540ea8bca5b4121e7cec2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.611809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38893febe24540ea8bca5b4121e7cec2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.619286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38893febe24540ea8bca5b4121e7cec2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:07.630197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1355/2708] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:07 2022] DELETE /identity/v3/users/38893febe24540ea8bca5b4121e7cec2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:07.630197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.630574 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e1858-8e43-43fa-80e9-f42480de06d5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.630751 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.693277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.693951 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.694234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.694509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.696346 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.699614 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0752ef-9231-46c8-a6e0-a4385ac82112 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.705318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.705884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.706163 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.706433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.707074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.709084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727ca93-3ec7-4df6-88a6-cce65a00e787 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.732650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:07.740995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1356/2709] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:07.742593 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.744013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.744013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.763978 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:07.772800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:07.774124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.778669 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.781265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.784448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1357/2710] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:07.789882 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.793195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1354/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:07.803253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.805658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:07.813210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d079440-21de-4470-96c8-876e2bc2c35b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.820897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.821889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.822394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.822714 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.823819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.826327 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.849212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1358/2712] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:07.853669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.883318 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c4b7-9c89-443c-9b68-de9c24e325ae admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.892125 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.893118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.893610 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.894059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.895159 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.898322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.913204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372020-6a11-4256-9e52-dd9565746eb3 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.917834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1359/2713] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:07.919341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.921412 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.921801 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.922235 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.922457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:07.933228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea1eb0-4bf6-4fae-92f8-009e66a409b7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:07.934687 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.936596 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982291d-af15-4295-9257-8d8f616614b4 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.938647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:07.939301 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.939597 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.939848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] PATH_INFO: `/v3/projects/78aba8d584ee429ebf7fc76f9dac885f/users/3d5c4377b91b4b79963fe4aeb348fcbe/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:07.949207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1355/2714] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:07.960642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aba8d584ee429ebf7fc76f9dac885f, user_id=3d5c4377b91b4b79963fe4aeb348fcbe, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:07.962590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:07.980170 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1360/2715] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:07 2022] PUT /identity/v3/projects/78aba8d584ee429ebf7fc76f9dac885f/users/3d5c4377b91b4b79963fe4aeb348fcbe/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:07.986487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:07.986944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:07.987318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:08.011587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:08.012807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:08.081526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1356/2716] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:08.091432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:08.094034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:08.166029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392ee1-6a98-491f-912a-0e959bf80588 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:08.170118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:08.170785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:08.170785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:08.171542 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:08.183262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:08.185152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:08.199034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1361/2717] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:08.276345 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:08.280962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:08.299782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e90b22-86d8-4750-9b38-bb71c093ce2f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:08.305459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:08.306336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:08.306622 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:08.307114 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] PATH_INFO: `/v3/projects/f739ca41c224410280585c6bc7aef95b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:08.309175 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f739ca41c224410280585c6bc7aef95b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:08.313233 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:08.393986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f739ca41c224410280585c6bc7aef95b', 'request_id': 'req-31fb1d17-9692-4ed5-9a6d-9e33775cad96'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.402437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f739ca41c224410280585c6bc7aef95b', 'request_id': 'req-31fb1d17-9692-4ed5-9a6d-9e33775cad96'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.411416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f739ca41c224410280585c6bc7aef95b', 'request_id': 'req-31fb1d17-9692-4ed5-9a6d-9e33775cad96'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.428501 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] The token cache is being invalidate because project f739ca41c224410280585c6bc7aef95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:08.428955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.430112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31fb1d17-9692-4ed5-9a6d-9e33775cad96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.431693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1357/2718] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:08 2022] DELETE /identity/v3/projects/f739ca41c224410280585c6bc7aef95b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:08.435937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:08.447752 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8ace-7790-42f0-a5c4-7f20c12289cf service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:08.523886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:08.524532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:08.524808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:08.525080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] PATH_INFO: `/v3/users/f52c53468a8f4cbaa6036462bd0866ce` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:08.526437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52c53468a8f4cbaa6036462bd0866ce)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:08.528445 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:08.598984 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52c53468a8f4cbaa6036462bd0866ce'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.604816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:08.610169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52c53468a8f4cbaa6036462bd0866ce'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.610933 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52c53468a8f4cbaa6036462bd0866ce'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.629870 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52c53468a8f4cbaa6036462bd0866ce'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.640792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52c53468a8f4cbaa6036462bd0866ce'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:08.647958 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1362/2719] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:08 2022] DELETE /identity/v3/users/f52c53468a8f4cbaa6036462bd0866ce => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:08.945813 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:08.946532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:08.946532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:08.993217 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] MFA Rules not processed for user `3d5c4377b91b4b79963fe4aeb348fcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:08.994136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:08.998348 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.001397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:09.016648 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:09.119834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1358/2720] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:09.125206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.126675 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:09.136111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960d0ba-f2bd-4f9b-b693-210603af9e81 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.142081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1614b-03f9-4c76-81d7-a47c4fe66230 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.142756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.143509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.143792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.144071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] PATH_INFO: `/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.145268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed67dbdc2ffe4d2aaa5d22f370be0b2b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.147432 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.167619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.168649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.169121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.172201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.175167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.179034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.231036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed67dbdc2ffe4d2aaa5d22f370be0b2b', 'request_id': 'req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:09.241384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1359/2721] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:09.247212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed67dbdc2ffe4d2aaa5d22f370be0b2b', 'request_id': 'req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:09.249830 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.262004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed67dbdc2ffe4d2aaa5d22f370be0b2b', 'request_id': 'req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:09.284642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] The token cache is being invalidate because project ed67dbdc2ffe4d2aaa5d22f370be0b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:09.285403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:09.285863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0e3ae723-4f8d-412b-a7f4-f795a02ebaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:09.289581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1363/2722] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:08 2022] DELETE /identity/v3/projects/ed67dbdc2ffe4d2aaa5d22f370be0b2b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:09.293688 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c780-10c4-4080-9823-c9acba99d861 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.293978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c780-10c4-4080-9823-c9acba99d861 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.294769 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c780-10c4-4080-9823-c9acba99d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.318228 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bc87c780-10c4-4080-9823-c9acba99d861 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:09.319474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bc87c780-10c4-4080-9823-c9acba99d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:09.362643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2be85-539b-4ed2-b123-1dd5a0234ed5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.376014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.376641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.376941 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.377213 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.377900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.380974 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.393111 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:09.417286 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1360/2723] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:09.423060 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1364/2724] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:09.423535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.428359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:09.432357 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.432626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.432904 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.453643 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898523-1bf2-4dec-8f1f-b5575601c8d7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.455952 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:09.457324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:09.467993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.471507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.472038 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.472710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.473779 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1365/2725] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:09.473933 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.475904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.479130 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.489341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abef52-fc61-4f6e-8427-0e1c0fd81ae1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.493539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1361/2726] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:09.495583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.500036 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.500908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.501393 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.501940 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.503196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:09.503733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.507123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.510541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1af7-e266-492f-86ea-52ffd8934cf0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.518720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.519341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.520220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.520220 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] PATH_INFO: `/v3/projects/baee9142727d491c8b06d6f7144c57b5/users/20336c154fb54062b06d77c00f8e2f8c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.541106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1366/2727] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:09.542845 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.543672 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=baee9142727d491c8b06d6f7144c57b5, user_id=20336c154fb54062b06d77c00f8e2f8c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.547881 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.565815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb1d2-a3cd-405b-8391-33e43b3dbd83 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.573406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1362/2728] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:09 2022] PUT /identity/v3/projects/baee9142727d491c8b06d6f7144c57b5/users/20336c154fb54062b06d77c00f8e2f8c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:09.574340 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.627952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:09.643694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.644328 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.644604 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.644883 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.645687 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.647674 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.656483 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e46cc-78e3-46d6-8098-ecfceb3a56aa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.662867 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.665019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.665019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.665019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.665019 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.665934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.678545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1363/2729] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:09.684134 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.693250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1367/2730] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:09.696363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acf02d-c7dc-4492-aeac-934ab0b55576 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.698571 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.767169 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.767968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.768245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.768523 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] PATH_INFO: `/v3/projects/baee9142727d491c8b06d6f7144c57b5/users/20336c154fb54062b06d77c00f8e2f8c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.770565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baee9142727d491c8b06d6f7144c57b5, user_id=20336c154fb54062b06d77c00f8e2f8c, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.773148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.774834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aa0f1-d93f-4bee-8685-810369916cc7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.779572 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.780737 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.781017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.781311 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.782035 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.784193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.785945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1364/2731] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:09 2022] PUT /identity/v3/projects/baee9142727d491c8b06d6f7144c57b5/users/20336c154fb54062b06d77c00f8e2f8c/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:09.814451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1368/2732] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:09 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:09.819604 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.895121 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d738-05e1-4b39-acf9-9719ec532ea3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.901533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.902150 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.902462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.902770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.903555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.905225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.918264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1365/2733] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:09.923145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.939980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8711b-073a-404e-b731-cffa692599b6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.950176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.951070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.951359 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.951798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:09.953156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:09.955297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e966d-56b0-4a10-8ecb-82cb9117b63d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:09.967200 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1369/2734] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:09.973172 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:09.984577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc7fa-2c2b-4586-814d-888238bb5f04 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:09.990724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:09.991406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:09.991838 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:09.992123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] PATH_INFO: `/v3/projects/c9afdd0618294489b6bd28812245b18d/users/0c5670314e4343c5b181bdc3e985aa91/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.011133 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9afdd0618294489b6bd28812245b18d, user_id=0c5670314e4343c5b181bdc3e985aa91, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.013937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.030904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1366/2735] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:09 2022] PUT /identity/v3/projects/c9afdd0618294489b6bd28812245b18d/users/0c5670314e4343c5b181bdc3e985aa91/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:10.041519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.041834 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.042106 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.076488 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] MFA Rules not processed for user `0c5670314e4343c5b181bdc3e985aa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:10.079702 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:10.120832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:10.162745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1370/2736] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:10.169639 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.231975 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:10.259425 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566f19-c998-4abe-8687-69e35a54a942 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.265632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.266324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.266945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.266945 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.267509 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.269532 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.304996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1367/2737] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:10.308951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.321317 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357359-63ff-4fa8-be9b-ba2118baaa5b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.415971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.416591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.416878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.417158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.417838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.419777 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.445594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1371/2738] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:10.450028 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.466123 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b4c5f-dde9-4c87-bfc1-25e504ac04df admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.473623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.474415 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.474701 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.474953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.475791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.477988 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.490401 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1368/2739] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:10.494531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.507910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f88f-709e-486b-a746-ff00cb68cfa0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.512535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.513194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.513523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.513835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] PATH_INFO: `/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b/users/e4d1ce2eba8d49e296a9f4df6328c743/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.538353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6e818ea46c4c4bbb3d1e6d925aa19b, user_id=e4d1ce2eba8d49e296a9f4df6328c743, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.548409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510abcb0-ca7d-4e15-9766-d5d48f660d31 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.591391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1372/2740] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:10 2022] PUT /identity/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b/users/e4d1ce2eba8d49e296a9f4df6328c743/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:10.596902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.609187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878027-1b38-4404-ab9a-078fc592577b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.624464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418ad2-3a91-40dd-82e3-b4eb5502c9ab None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.624692 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418ad2-3a91-40dd-82e3-b4eb5502c9ab None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.624977 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418ad2-3a91-40dd-82e3-b4eb5502c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.675947 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ac418ad2-3a91-40dd-82e3-b4eb5502c9ab None None] MFA Rules not processed for user `20336c154fb54062b06d77c00f8e2f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:10.678761 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ac418ad2-3a91-40dd-82e3-b4eb5502c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:10.700845 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765648-2635-4e50-bee8-140350016651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.701473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765648-2635-4e50-bee8-140350016651 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.703218 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765648-2635-4e50-bee8-140350016651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.703506 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765648-2635-4e50-bee8-140350016651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.704195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36765648-2635-4e50-bee8-140350016651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.707098 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36765648-2635-4e50-bee8-140350016651 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.738856 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1369/2741] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:10.743580 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765648-2635-4e50-bee8-140350016651 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.759165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765648-2635-4e50-bee8-140350016651 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:10.767765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:10.768568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.768879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.769354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] PATH_INFO: `/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b/users/e4d1ce2eba8d49e296a9f4df6328c743/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.772037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6e818ea46c4c4bbb3d1e6d925aa19b, user_id=e4d1ce2eba8d49e296a9f4df6328c743, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:10.774820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640037-cc59-4353-8948-b545f1f1ef43 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:10.800476 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1370/2742] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:10 2022] PUT /identity/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b/users/e4d1ce2eba8d49e296a9f4df6328c743/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:10.803591 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.804180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.804755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.806832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1373/2743] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:10.819053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:10.819341 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:10.820152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:10.862009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] MFA Rules not processed for user `3d5c4377b91b4b79963fe4aeb348fcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:10.864759 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:10.875859 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] MFA Rules not processed for user `e4d1ce2eba8d49e296a9f4df6328c743`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:10.877600 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:10.898097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:10.950011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1374/2744] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:10.964074 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.966633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:10.981201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1371/2745] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:10.989805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:10.992295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.036392 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:11.076086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1664f-b22d-488b-8213-cc4aa50c370c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:11.079103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed31db-178d-414e-8a93-8b56506f8489 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:11.083048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:11.083908 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.084306 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.084843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.086217 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:11.086833 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.087134 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.087405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.089401 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.098836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:11.100823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:11.103795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:11.105755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:11.118097 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1372/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:11.121581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1375/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:11.292243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:11.379315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbed6d-4420-49ca-b504-bffd260b9dcd service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:11.384363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:11.385054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.385324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.385642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] PATH_INFO: `/v3/users/0c5670314e4343c5b181bdc3e985aa91` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.386781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5670314e4343c5b181bdc3e985aa91)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:11.388709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:11.413251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:11.415144 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.447457 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5670314e4343c5b181bdc3e985aa91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:11.459855 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5670314e4343c5b181bdc3e985aa91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:11.478393 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5670314e4343c5b181bdc3e985aa91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:11.487902 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5670314e4343c5b181bdc3e985aa91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:11.488647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-99c241be-90ff-416d-b526-8689ee0ed4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5670314e4343c5b181bdc3e985aa91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:11.496739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1373/2748] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:11 2022] DELETE /identity/v3/users/0c5670314e4343c5b181bdc3e985aa91 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:11.500526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37fb8d-5cf9-439b-b7b2-964e30ec405e service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:11.503416 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.503705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.503977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.524338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:11.525880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.571934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:11.572547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.572835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.573164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.575018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.581919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:11.588594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:11.591499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:11.601864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1376/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:11.603780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1374/2750] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:11.615719 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:11.617202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:11.629334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af92ec-1115-4fc2-8e87-1319fd9a685a service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:11.634743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:11.635765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:11.636253 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:11.636998 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:11.649877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:11.651438 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:11.659639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:11.668798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1377/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:12.038473 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:12.041267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:12.055654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c860-8e11-442b-a2ea-408d24c3b0f7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:12.081788 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:12.082957 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:12.083397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:12.083873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] PATH_INFO: `/v3/projects/c9afdd0618294489b6bd28812245b18d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:12.088918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9afdd0618294489b6bd28812245b18d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:12.094728 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:12.188914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:12.190739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:12.208992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9afdd0618294489b6bd28812245b18d', 'request_id': 'req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.215821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944228-65bb-4021-86bc-d7c9b0bb6ec6 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:12.221111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9afdd0618294489b6bd28812245b18d', 'request_id': 'req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.239347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9afdd0618294489b6bd28812245b18d', 'request_id': 'req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.263640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] The token cache is being invalidate because project c9afdd0618294489b6bd28812245b18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:12.264043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.264931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.273577 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1375/2752] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:12 2022] DELETE /identity/v3/projects/c9afdd0618294489b6bd28812245b18d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:12.278827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:12.283946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:12.306173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:12.307562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:12.308115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:12.308887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] PATH_INFO: `/v3/users/cde14c40977d4343962a082c67fed43b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:12.310669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde14c40977d4343962a082c67fed43b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:12.313930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:12.392898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde14c40977d4343962a082c67fed43b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.394890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5338d37-08ab-47b5-a68a-bf3453ddf9bb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:12.403698 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:12.404355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde14c40977d4343962a082c67fed43b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.405551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:12.405944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:12.406469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] PATH_INFO: `/v3/users/e4d1ce2eba8d49e296a9f4df6328c743` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:12.406632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde14c40977d4343962a082c67fed43b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.410084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d1ce2eba8d49e296a9f4df6328c743)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:12.415724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:12.431928 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde14c40977d4343962a082c67fed43b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.446222 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-adf8bacb-6dc9-4b9e-b161-42d25d749de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde14c40977d4343962a082c67fed43b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.461647 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1378/2753] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:12 2022] DELETE /identity/v3/users/cde14c40977d4343962a082c67fed43b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:12.467037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:12.467533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:12.468513 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:12.496144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d1ce2eba8d49e296a9f4df6328c743'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.501911 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:12.503767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:12.509847 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d1ce2eba8d49e296a9f4df6328c743'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.534852 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d1ce2eba8d49e296a9f4df6328c743'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.536493 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:12.546993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d1ce2eba8d49e296a9f4df6328c743'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.548141 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d1ce2eba8d49e296a9f4df6328c743'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:12.562599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1376/2754] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:12 2022] DELETE /identity/v3/users/e4d1ce2eba8d49e296a9f4df6328c743 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:12.606923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1379/2755] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:12.621300 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:12.623017 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:12.747487 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910643e8-bc44-4f3e-a198-f1128a15b3e0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:12.752702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:12.753379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:12.753746 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:12.754081 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:12.883727 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:12.887291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb0f1-284f-486f-8fd4-7be8bc1b000c service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:12.907465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1377/2756] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:13.019150 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.020815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.039408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952cc8-fd70-458a-b4b7-25ec4ad7125c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.047113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.049619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.049619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.049619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] PATH_INFO: `/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.051142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6e818ea46c4c4bbb3d1e6d925aa19b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.053378 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.078852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:13.143927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6e818ea46c4c4bbb3d1e6d925aa19b', 'request_id': 'req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.159345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6e818ea46c4c4bbb3d1e6d925aa19b', 'request_id': 'req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.167502 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6e818ea46c4c4bbb3d1e6d925aa19b', 'request_id': 'req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.186964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] The token cache is being invalidate because project fd6e818ea46c4c4bbb3d1e6d925aa19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:13.187474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.188181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.193387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1380/2757] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:13 2022] DELETE /identity/v3/projects/fd6e818ea46c4c4bbb3d1e6d925aa19b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:13.195791 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03310aa-0d22-48c6-9123-e47d94f15df1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.196961 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03310aa-0d22-48c6-9123-e47d94f15df1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.197395 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03310aa-0d22-48c6-9123-e47d94f15df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.224239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f03310aa-0d22-48c6-9123-e47d94f15df1 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:13.226021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f03310aa-0d22-48c6-9123-e47d94f15df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.331562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.333457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.358964 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1378/2758] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:13.363703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdb3-809b-4ae4-8b52-c1446ba0886c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.374858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.375477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.375948 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.383171 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.385510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.386211 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.386700 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] PATH_INFO: `/v3/projects/72c7d0fd730e4f14b8de1bacc6a3c58a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.390156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c7d0fd730e4f14b8de1bacc6a3c58a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.394227 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.403337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:13.404720 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.425229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1379/2759] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:13.426353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.438409 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc13e6-50d8-4236-a2eb-2efb367ad072 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.444554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.445259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.445737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.446095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.446823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:13.447201 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.449115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.476239 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1380/2760] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:13.477664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.491351 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabacb1e-f9d1-43d8-b233-f7695004a13e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.509534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.510521 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.511552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.512208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.513545 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.518444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.521049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c7d0fd730e4f14b8de1bacc6a3c58a', 'request_id': 'req-e78584b3-b218-4b55-80aa-88a373b57213'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.539965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c7d0fd730e4f14b8de1bacc6a3c58a', 'request_id': 'req-e78584b3-b218-4b55-80aa-88a373b57213'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.556675 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c7d0fd730e4f14b8de1bacc6a3c58a', 'request_id': 'req-e78584b3-b218-4b55-80aa-88a373b57213'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.570203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:13.583464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] The token cache is being invalidate because project 72c7d0fd730e4f14b8de1bacc6a3c58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:13.584712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.586003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.588893 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1381/2761] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:13 2022] DELETE /identity/v3/projects/72c7d0fd730e4f14b8de1bacc6a3c58a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:13.590879 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1381/2762] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:13.595303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.597214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.599627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.604331 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.732155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91f195-4ed5-4cf5-95d4-3db4944da6aa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.742332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.743299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.743754 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.744276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.745882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.748666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.753931 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78584b3-b218-4b55-80aa-88a373b57213 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.766329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.767070 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.767385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.767723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] PATH_INFO: `/v3/users/87e4dd7941494b6bad4502c9eaa5b892` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.769821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e4dd7941494b6bad4502c9eaa5b892)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.774165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.795490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1382/2763] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:13 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:13.800836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.818311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbe2a8-0a5a-4021-bf58-6b3df05fbef7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.826693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.828344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.829177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.829784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.830982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.833908 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:13.834135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.862491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1383/2764] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:13.864122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.872678 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e4dd7941494b6bad4502c9eaa5b892'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.879914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440694-4cc4-453c-9f68-a7eb2b20a81d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:13.886747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e4dd7941494b6bad4502c9eaa5b892'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.887782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e4dd7941494b6bad4502c9eaa5b892'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.890315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:13.891369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:13.891827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:13.892296 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:13.893216 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:13.896136 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:13.914851 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e4dd7941494b6bad4502c9eaa5b892'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.921549 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1384/2765] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:13.923129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:13.925782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:13.932475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d5114ed0-d7c1-479c-a3af-d7668cf15b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e4dd7941494b6bad4502c9eaa5b892'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:13.944374 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1382/2766] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:13 2022] DELETE /identity/v3/users/87e4dd7941494b6bad4502c9eaa5b892 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:13.947426 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1035b-f2b2-4670-918d-df95bceecd7b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.025229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.026337 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.026898 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.027283 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] PATH_INFO: `/v3/projects/6fe20da2520b4c858de0324b11368686/users/584448f056184170a6a4b8dc90c5744b/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.050261 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe20da2520b4c858de0324b11368686, user_id=584448f056184170a6a4b8dc90c5744b, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.053968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.074250 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1385/2767] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:13 2022] PUT /identity/v3/projects/6fe20da2520b4c858de0324b11368686/users/584448f056184170a6a4b8dc90c5744b/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:14.086224 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.086765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.087199 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.130373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] MFA Rules not processed for user `584448f056184170a6a4b8dc90c5744b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:14.131623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:14.216083 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1383/2768] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:14.222808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.300245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:14.333547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753914e-f23a-4ec2-9fe9-a38609dda8ad admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.342193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.343582 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.343966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.344404 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.345571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.347820 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.388356 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.391946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:14.399260 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1386/2769] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:14 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:14.404514 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.424864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda9bb-670b-4862-bb7f-9ae812e96314 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.503059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.503942 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.504173 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.504418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] PATH_INFO: `/v3/projects/05d93c51f77c40f9867090737c30f3b8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.505814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d93c51f77c40f9867090737c30f3b8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.507790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.534952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd834-b7bd-42ba-a3d1-e95468216a94 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.544497 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.545259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.545718 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.546014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.546997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.550182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.559194 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:14.582232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d93c51f77c40f9867090737c30f3b8', 'request_id': 'req-0f3f356e-817f-4010-9476-d4d087593b44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.590835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d93c51f77c40f9867090737c30f3b8', 'request_id': 'req-0f3f356e-817f-4010-9476-d4d087593b44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.591937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1387/2770] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:14 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:14.598219 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.598526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d93c51f77c40f9867090737c30f3b8', 'request_id': 'req-0f3f356e-817f-4010-9476-d4d087593b44'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.615181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] The token cache is being invalidate because project 05d93c51f77c40f9867090737c30f3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:14.615820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.616025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569673-822d-4558-9e24-7feece684db6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.616925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.619004 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1384/2771] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:14 2022] DELETE /identity/v3/projects/05d93c51f77c40f9867090737c30f3b8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:14.623659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.627072 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:14.697236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.697869 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.698149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.698428 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.699107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.700935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.713575 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1388/2772] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:14.719405 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.721635 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:14.736434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f356e-817f-4010-9476-d4d087593b44 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.739151 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825732-1db2-4de9-94e8-7dc86e7b76ad admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:14.742027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.742889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.743235 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.743583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] PATH_INFO: `/v3/users/86096737de8e467591f339b0410e2272` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.744837 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86096737de8e467591f339b0410e2272)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.745112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:14.745968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:14.746444 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:14.746872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] PATH_INFO: `/v3/projects/eddd327005c241cfb22c179b30bd3acf/users/ce2103a78d924b3587df63507345cc0d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:14.747306 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.770146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddd327005c241cfb22c179b30bd3acf, user_id=ce2103a78d924b3587df63507345cc0d, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:14.773742 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:14.796354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1389/2773] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:14 2022] PUT /identity/v3/projects/eddd327005c241cfb22c179b30bd3acf/users/ce2103a78d924b3587df63507345cc0d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:14.802930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:14.818995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86096737de8e467591f339b0410e2272'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.829816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86096737de8e467591f339b0410e2272'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.831320 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86096737de8e467591f339b0410e2272'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.857380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86096737de8e467591f339b0410e2272'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.871533 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86096737de8e467591f339b0410e2272'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:14.875441 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:14.886673 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1385/2774] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:14 2022] DELETE /identity/v3/users/86096737de8e467591f339b0410e2272 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:14.921159 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e771-dc2f-4e33-8d51-5b1fa847a5c0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.014119 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.015980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.016465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.016987 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.017839 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.020828 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51656942-b692-4952-8018-4337f5922c12 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.039755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1390/2775] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:15.044172 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.046343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.069573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e3a8-d6da-4328-beb5-9dd4d9333cc3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.074923 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.075723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.076180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.076480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] PATH_INFO: `/v3/projects/eddd327005c241cfb22c179b30bd3acf/users/ce2103a78d924b3587df63507345cc0d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.079372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddd327005c241cfb22c179b30bd3acf, user_id=ce2103a78d924b3587df63507345cc0d, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.082260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.117676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1386/2776] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:15 2022] PUT /identity/v3/projects/eddd327005c241cfb22c179b30bd3acf/users/ce2103a78d924b3587df63507345cc0d/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:15.126770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.127135 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.131112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.179780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] MFA Rules not processed for user `ce2103a78d924b3587df63507345cc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:15.182000 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.256889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.259275 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.335044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:15.346237 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1391/2777] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:15.355199 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.357194 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.397855 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4489-a6c2-4882-8781-ccf60b66a457 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.403458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.404107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.404386 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.404658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] PATH_INFO: `/v3/projects/6fbc18c843ff459ba60198ed56cfaec7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.407223 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbc18c843ff459ba60198ed56cfaec7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.409814 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.472921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571499-cc5c-4c49-853c-284e24fe2dbf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.488830 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbc18c843ff459ba60198ed56cfaec7', 'request_id': 'req-12702608-f9ff-4ca1-b7ec-7c918ea25b79'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:15.500776 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbc18c843ff459ba60198ed56cfaec7', 'request_id': 'req-12702608-f9ff-4ca1-b7ec-7c918ea25b79'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:15.508931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:15.510030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbc18c843ff459ba60198ed56cfaec7', 'request_id': 'req-12702608-f9ff-4ca1-b7ec-7c918ea25b79'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:15.527887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] The token cache is being invalidate because project 6fbc18c843ff459ba60198ed56cfaec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:15.528800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:15.529519 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12702608-f9ff-4ca1-b7ec-7c918ea25b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:15.531324 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1387/2778] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:15 2022] DELETE /identity/v3/projects/6fbc18c843ff459ba60198ed56cfaec7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:15.536900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e08-2439-412b-bf08-f76a270a81ad None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.537183 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e08-2439-412b-bf08-f76a270a81ad None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.537461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6e08-2439-412b-bf08-f76a270a81ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.555599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.556773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.557231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.557724 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.558895 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-997a6e08-2439-412b-bf08-f76a270a81ad None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:15.560145 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-997a6e08-2439-412b-bf08-f76a270a81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.563623 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.662656 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1388/2779] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:15.677285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.677627 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.677878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.696073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.698206 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.709783 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:15.711181 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:15.726685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1389/2780] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:15.726959 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1392/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:15.727511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.749403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5fd08-4d80-4ba3-b6a7-66420a494446 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.749403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.749403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.749403 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.750164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.750164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:15.750164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.751869 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.776497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1390/2782] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:15.782474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.798906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8fd51-18d7-41d1-abfc-2c7a2347ea37 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.807187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.808200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.808710 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.809198 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.810434 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:15.815882 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:15.876976 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1393/2783] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:15 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:15.877897 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:15.893546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214d780-da21-47ec-a553-4e27ebb993f6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:15.969251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:15.995175 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:15.995856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:15.996216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:15.996607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:15.997370 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.000578 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.034258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1391/2784] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:15 2022] POST /identity/v3/users => generated 282 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:16.046660 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.059942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e8cc-eb0d-4fa8-bb74-db21d85c8604 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.065804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.066408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.066795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.067163 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.067943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.070195 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.085273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1394/2785] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:16.089764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.118671 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a4418-7491-49fb-86ae-ec987d93c951 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.126968 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.128699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.128699 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.128905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.130313 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.133103 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6de6-af15-4260-b563-a20f272dfcf6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.149659 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1392/2786] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:16.153901 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.165391 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585adc3-dce2-4c34-a844-6fac369fe87d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.173105 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.174760 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.175189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.175681 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] PATH_INFO: `/v3/projects/e340a1a8fadf45609bb219c58b860de5/users/4d8e2481260c45218bd229002612efd3/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.198729 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e340a1a8fadf45609bb219c58b860de5, user_id=4d8e2481260c45218bd229002612efd3, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.204907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.222736 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1395/2787] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:16 2022] PUT /identity/v3/projects/e340a1a8fadf45609bb219c58b860de5/users/4d8e2481260c45218bd229002612efd3/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:16.234981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.235505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.235865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.270343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] MFA Rules not processed for user `4d8e2481260c45218bd229002612efd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:16.271584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:16.357383 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1393/2788] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:16.370753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.372526 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:16.449120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2b8d-a3ab-4541-8f05-eb5e744a6713 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.457144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.457822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.458108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.458384 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.475256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.475256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c6496-d889-4b8c-b105-b3ba72ca51e4 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.487278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1396/2789] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:16.496523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.498290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:16.576257 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760a1fb-c39f-4764-b1cf-92e088e00668 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.586944 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.587642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.587925 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.588232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] PATH_INFO: `/v3/users/584448f056184170a6a4b8dc90c5744b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.589997 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=584448f056184170a6a4b8dc90c5744b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.592230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.651345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584448f056184170a6a4b8dc90c5744b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:16.656097 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:16.661628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584448f056184170a6a4b8dc90c5744b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:16.662754 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584448f056184170a6a4b8dc90c5744b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:16.685366 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584448f056184170a6a4b8dc90c5744b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:16.696434 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584448f056184170a6a4b8dc90c5744b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:16.705735 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1394/2790] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:16 2022] DELETE /identity/v3/users/584448f056184170a6a4b8dc90c5744b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:16.710144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.710453 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.710763 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.738952 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:16.740265 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:16.753542 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:16.837528 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1397/2791] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:16.855999 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:16.856765 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:16.939905 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c070a-525b-4451-89f7-423cec2adcb7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:16.943628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:16.944266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:16.944541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:16.944810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:16.955920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:16.957387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:16.971444 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1395/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:17.317653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:17.320293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:17.338795 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e48157-4b07-4cc8-a291-61122939532c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:17.354910 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:17.355657 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:17.355935 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:17.356359 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] PATH_INFO: `/v3/projects/6fe20da2520b4c858de0324b11368686` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:17.357740 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe20da2520b4c858de0324b11368686)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:17.360278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:17.430649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe20da2520b4c858de0324b11368686', 'request_id': 'req-b4a89bcc-ab6c-4273-910a-fd5de7245efd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.440966 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe20da2520b4c858de0324b11368686', 'request_id': 'req-b4a89bcc-ab6c-4273-910a-fd5de7245efd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.449319 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe20da2520b4c858de0324b11368686', 'request_id': 'req-b4a89bcc-ab6c-4273-910a-fd5de7245efd'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.462776 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] The token cache is being invalidate because project 6fe20da2520b4c858de0324b11368686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:17.463094 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.463797 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.465338 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1398/2793] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:17 2022] DELETE /identity/v3/projects/6fe20da2520b4c858de0324b11368686 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:17.470336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:17.482156 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be4f88-d879-49ee-bbc3-4121f0c3bbab service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:17.563107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:17.563775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:17.564032 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:17.564358 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] PATH_INFO: `/v3/users/ce2103a78d924b3587df63507345cc0d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:17.565636 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2103a78d924b3587df63507345cc0d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:17.568120 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:17.636415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2103a78d924b3587df63507345cc0d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.646539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2103a78d924b3587df63507345cc0d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.647296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2103a78d924b3587df63507345cc0d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.664721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2103a78d924b3587df63507345cc0d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.667023 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:17.678174 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-88d4bac6-12ca-4f50-8cfb-c1756b78caa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2103a78d924b3587df63507345cc0d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:17.686847 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1396/2794] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:17 2022] DELETE /identity/v3/users/ce2103a78d924b3587df63507345cc0d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:18.085468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:18.093402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:18.117059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89bcc-ab6c-4273-910a-fd5de7245efd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:18.208203 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:18.208849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.209126 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.209396 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] PATH_INFO: `/v3/projects/eddd327005c241cfb22c179b30bd3acf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.210587 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eddd327005c241cfb22c179b30bd3acf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:18.212486 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:18.290277 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:18.297735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eddd327005c241cfb22c179b30bd3acf', 'request_id': 'req-f3ac9a93-685f-4a21-bd14-cd1d1b584787'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:18.314139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eddd327005c241cfb22c179b30bd3acf', 'request_id': 'req-f3ac9a93-685f-4a21-bd14-cd1d1b584787'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:18.333471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eddd327005c241cfb22c179b30bd3acf', 'request_id': 'req-f3ac9a93-685f-4a21-bd14-cd1d1b584787'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:18.366702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] The token cache is being invalidate because project eddd327005c241cfb22c179b30bd3acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:18.367191 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:18.368448 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f3ac9a93-685f-4a21-bd14-cd1d1b584787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:18.378477 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1399/2795] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:18 2022] DELETE /identity/v3/projects/eddd327005c241cfb22c179b30bd3acf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:18.379437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.379722 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.380034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.446487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:18.448323 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:18.581052 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1397/2796] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:18.593767 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.594593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.594745 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.645942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:18.651251 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:18.660738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1400/2797] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:18.667373 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:18.680946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6577f27-9b1c-45cb-a4af-fc4df55dfc1f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:18.686260 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:18.687100 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.687385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.687663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.688562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:18.689307 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:18.691957 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:18.714184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1398/2798] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:07:18.716165 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:18.735274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1477-e0f7-4f1e-9df4-b230d1622089 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:18.741750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:18.742569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.742904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.743253 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.744025 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:18.746737 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:18.799832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1401/2799] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:18 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:18.801423 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:18.816927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ca06-0525-427a-9b9d-e3b157d99b37 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:18.909577 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:18.910204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.910511 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.910786 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.911458 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:18.913460 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:18.944481 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1399/2800] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:18 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:18.949989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:18.962568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21735a-e814-47aa-aca2-f77625c28321 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:18.971613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:18.972264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:18.972546 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:18.972825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:18.973515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:18.975308 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:18.987369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1402/2801] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:18.991832 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.005355 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a10448-bed5-49f4-956b-9fa3034381a4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.011409 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.012203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.012581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.012971 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.013863 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.016531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670ed6-7ad8-49ac-979b-aa87eb8aadd4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.032126 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1400/2802] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:19.038204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.050491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588a069-ee84-4dbc-95a8-5a929e165d91 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.055680 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.056370 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.056666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.056931 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] PATH_INFO: `/v3/projects/92ed34c6517e42dcb3deb27d67af3731/users/9d4b9247940e4fc9839d04450fef3c48/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.076365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ed34c6517e42dcb3deb27d67af3731, user_id=9d4b9247940e4fc9839d04450fef3c48, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.080288 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.099154 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1403/2803] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:19 2022] PUT /identity/v3/projects/92ed34c6517e42dcb3deb27d67af3731/users/9d4b9247940e4fc9839d04450fef3c48/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:19.110557 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.110824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.111261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.151237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] MFA Rules not processed for user `9d4b9247940e4fc9839d04450fef3c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:19.152491 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:19.205273 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:19.230029 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1401/2804] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:19.235708 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.314921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007705-1d9e-4973-8e84-0ba27d914d33 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.320086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.320712 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.320993 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.321267 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.321982 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.323942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.359429 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1404/2805] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:19.364176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.377089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead2828-69c3-4799-9ff6-9bdbce1924fd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.472121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.472936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.473743 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.474279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.475207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.478385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.505900 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1402/2806] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:19 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:19.511153 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.528533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe427-f1c4-4391-b6cb-ec228b59ee15 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.536245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.536891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.537129 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.537379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.538145 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.539913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.554618 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1405/2807] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:19.560402 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.576252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e8b4-bfc1-42f9-8cbc-515435999cfe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.583207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.583892 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.584169 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.584457 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] PATH_INFO: `/v3/projects/e2dd36b9424b4775be2a42dc477bd744/users/0abb9c75472c462dba97e8f217e2f2b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.603547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd36b9424b4775be2a42dc477bd744, user_id=0abb9c75472c462dba97e8f217e2f2b7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.606441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.627943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1403/2808] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:19 2022] PUT /identity/v3/projects/e2dd36b9424b4775be2a42dc477bd744/users/0abb9c75472c462dba97e8f217e2f2b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:19.634207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.647173 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067837c8-9d3e-404a-bdaa-8a38ce955b1b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.708535 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:19.744593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.745652 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.746122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.746583 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.747705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.751568 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec15164-b821-402f-a5e5-52cf2d98b31d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.768571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1406/2809] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:19.774196 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:19.787972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b721-275b-40b3-9d6c-9b4e7332230a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:19.794246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:19.794915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.795198 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.796112 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] PATH_INFO: `/v3/projects/e2dd36b9424b4775be2a42dc477bd744/users/0abb9c75472c462dba97e8f217e2f2b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.798965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd36b9424b4775be2a42dc477bd744, user_id=0abb9c75472c462dba97e8f217e2f2b7, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:19.802226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:19.819390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1404/2810] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:19 2022] PUT /identity/v3/projects/e2dd36b9424b4775be2a42dc477bd744/users/0abb9c75472c462dba97e8f217e2f2b7/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:19.833104 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:19.833613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:19.834100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:19.878565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] MFA Rules not processed for user `0abb9c75472c462dba97e8f217e2f2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:19.879936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:19.995849 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1407/2811] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:20.008877 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:20.011534 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:20.097745 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2271-b33a-4550-a1ef-7c2f72e06ecb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:20.114343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:20.127853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:20.127853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:20.127853 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:20.193730 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:20.202416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:20.206166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:20.221982 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1405/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:24.202890 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:24.205824 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:24.229818 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6aa11-42ce-49b5-91b2-2878eb00af02 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:24.235611 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:24.236268 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:24.236551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:24.236822 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:24.238752 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:24.346118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:24.347642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:24.359397 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1408/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:24.734815 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:24.745041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5c1b-6db6-49f0-a6c8-8da48c80624d service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:24.749624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:24.750267 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:24.750547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:24.750821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:24.761681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:24.763413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cb613-9eb5-41bc-b31f-4707753dae86 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:24.774493 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1406/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:30.080595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:30.179695 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:30.188037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a367-8bce-4db1-8fe3-f04e37277488 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:30.193631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:30.194343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:30.194741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:30.195089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] PATH_INFO: `/v3/users/9d4b9247940e4fc9839d04450fef3c48` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:30.196314 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4b9247940e4fc9839d04450fef3c48)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:30.198531 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:30.274466 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4b9247940e4fc9839d04450fef3c48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:30.288014 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4b9247940e4fc9839d04450fef3c48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:30.303777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4b9247940e4fc9839d04450fef3c48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:30.313862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4b9247940e4fc9839d04450fef3c48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:30.314743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4b9247940e4fc9839d04450fef3c48'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:30.324782 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1409/2815] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:30 2022] DELETE /identity/v3/users/9d4b9247940e4fc9839d04450fef3c48 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:30.332431 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:30.333292 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:30.333467 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:30.363027 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:30.364473 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:30.454448 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1407/2816] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:30.469677 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:30.473650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:30.567289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f34dfd-6df2-45c7-96d7-d9444f65e6db admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:30.573160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373650-c92c-413c-8736-429630675126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:30.574064 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373650-c92c-413c-8736-429630675126 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:30.574354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373650-c92c-413c-8736-429630675126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:30.574644 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2373650-c92c-413c-8736-429630675126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:30.585796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373650-c92c-413c-8736-429630675126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:30.587649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2373650-c92c-413c-8736-429630675126 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:30.600778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1410/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:31.004365 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:31.005407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:31.041804 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4513-6002-4a35-abf7-eaa0e2af4b03 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:31.048428 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:31.049340 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:31.049652 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:31.049922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] PATH_INFO: `/v3/projects/92ed34c6517e42dcb3deb27d67af3731` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:31.051230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ed34c6517e42dcb3deb27d67af3731)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:31.053387 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:31.131202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ed34c6517e42dcb3deb27d67af3731', 'request_id': 'req-3216f9d3-193f-4d53-a3d0-058178e835e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.142623 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ed34c6517e42dcb3deb27d67af3731', 'request_id': 'req-3216f9d3-193f-4d53-a3d0-058178e835e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.151082 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ed34c6517e42dcb3deb27d67af3731', 'request_id': 'req-3216f9d3-193f-4d53-a3d0-058178e835e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.169371 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] The token cache is being invalidate because project 92ed34c6517e42dcb3deb27d67af3731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:31.169721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.171084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.177002 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1408/2818] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:31 2022] DELETE /identity/v3/projects/92ed34c6517e42dcb3deb27d67af3731 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:31.179293 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373650-c92c-413c-8736-429630675126 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:31.190930 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2373650-c92c-413c-8736-429630675126 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:31.269291 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:31.269956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:31.270262 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:31.270540 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] PATH_INFO: `/v3/users/0abb9c75472c462dba97e8f217e2f2b7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:31.271716 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abb9c75472c462dba97e8f217e2f2b7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:31.273658 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:31.303943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:31.344048 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abb9c75472c462dba97e8f217e2f2b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.355513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abb9c75472c462dba97e8f217e2f2b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.370559 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abb9c75472c462dba97e8f217e2f2b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.379004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abb9c75472c462dba97e8f217e2f2b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.379873 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-63fb0823-f019-406b-8837-113fe28bc109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abb9c75472c462dba97e8f217e2f2b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.386650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1411/2819] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:31 2022] DELETE /identity/v3/users/0abb9c75472c462dba97e8f217e2f2b7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:31.719696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:31.721951 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:31.743561 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f9d3-193f-4d53-a3d0-058178e835e1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:31.825030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:31.825709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:31.825991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:31.826825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] PATH_INFO: `/v3/projects/e2dd36b9424b4775be2a42dc477bd744` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:31.828617 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dd36b9424b4775be2a42dc477bd744)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:31.830704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:31.838148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:31.903913 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dd36b9424b4775be2a42dc477bd744', 'request_id': 'req-57af6fda-a3f9-4e62-9db0-80f29616c4fb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.912725 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dd36b9424b4775be2a42dc477bd744', 'request_id': 'req-57af6fda-a3f9-4e62-9db0-80f29616c4fb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.920118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dd36b9424b4775be2a42dc477bd744', 'request_id': 'req-57af6fda-a3f9-4e62-9db0-80f29616c4fb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.941225 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] The token cache is being invalidate because project e2dd36b9424b4775be2a42dc477bd744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:31.941538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.942218 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-57af6fda-a3f9-4e62-9db0-80f29616c4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:31.943770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1409/2820] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:31 2022] DELETE /identity/v3/projects/e2dd36b9424b4775be2a42dc477bd744 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:31.949739 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:31.950031 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:31.950312 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:31.985565 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:31.986825 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:32.082638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1412/2821] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:32.096252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.096252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.096252 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.137696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:32.141329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:32.169064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1410/2822] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:32.176915 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.198259 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52583ad1-aec8-4a8a-a13b-13c4f02042a9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.205593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.206418 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.206694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.206968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.207628 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:32.207934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.209534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.222534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1413/2823] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:32.228421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.242978 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4ad6d-a7e5-48d2-87e3-0cb369db702f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.250936 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.251921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.252345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.252771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.254068 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.257443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.329545 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1411/2824] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:32 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:32.335379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.356387 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abaa5-0327-4bc5-9d16-d43f46aea687 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.477854 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.478459 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.478731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.479002 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.479656 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.481595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.509674 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1414/2825] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:32 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:32.515415 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.531798 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a10cd-f11f-464f-b9bb-cb95ce425776 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.538110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.538738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.539031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.539304 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.539960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.541760 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.555293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1412/2826] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:32.561310 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.572374 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c8bf4-eb81-433c-b920-e5e69935fcc5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.579142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.579773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.580041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.580311 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.580958 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.582640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b2a31-38d3-4a4e-b230-4e60c8169c53 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.597361 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1415/2827] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:32.601790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.613920 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601acb-387f-46cb-8aed-847d3cfa1164 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.618831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.619594 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.619981 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.620344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] PATH_INFO: `/v3/projects/4f53ebda32884b39925693bcdcfaf95d/users/eec35880c13f4cc3bbc7cb932f96742b/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.640011 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f53ebda32884b39925693bcdcfaf95d, user_id=eec35880c13f4cc3bbc7cb932f96742b, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.643926 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.659681 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1413/2828] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:32 2022] PUT /identity/v3/projects/4f53ebda32884b39925693bcdcfaf95d/users/eec35880c13f4cc3bbc7cb932f96742b/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:32.666478 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289ad9-1f09-4ce8-8592-d93b8b28368c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.666759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289ad9-1f09-4ce8-8592-d93b8b28368c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.667026 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289ad9-1f09-4ce8-8592-d93b8b28368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.675653 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:32.692484 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2e289ad9-1f09-4ce8-8592-d93b8b28368c None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:32.693832 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2e289ad9-1f09-4ce8-8592-d93b8b28368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:32.776561 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1416/2829] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:32.787789 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:32.790229 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:32.862910 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f1582-fa98-49de-a043-975474d8555e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:32.868841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:32.869865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:32.870322 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:32.870767 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:32.885077 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:32.886841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:32.898453 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1414/2830] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:33.852706 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9a0e-ab47-4e80-bce0-28fbc83c9fc2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:33.854435 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9a0e-ab47-4e80-bce0-28fbc83c9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:33.854939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9a0e-ab47-4e80-bce0-28fbc83c9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:33.897999 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2e7e9a0e-ab47-4e80-bce0-28fbc83c9fc2 None None] MFA Rules not processed for user `eec35880c13f4cc3bbc7cb932f96742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:33.899569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2e7e9a0e-ab47-4e80-bce0-28fbc83c9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:34.012777 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1417/2831] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:34.035475 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:34.037921 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:34.115822 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:34.159802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609298-74ac-4915-9a84-e5e81da1edf5 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:34.174118 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:34.175160 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:34.175630 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:34.176114 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:34.186580 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:34.188142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:34.198094 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1415/2832] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:35.893916 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:35.894750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:35.894750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:35.923440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] MFA Rules not processed for user `eec35880c13f4cc3bbc7cb932f96742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:35.925243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:35.936113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1418/2833] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:44.193477 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=11 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:45.915942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=61 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:47.078334 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:47.081528 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:47.212030 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c16a49-8760-47e1-ba28-43dd4aec5d54 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:47.218624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:47.219279 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:47.219555 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:47.219836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] PATH_INFO: `/v3/users/3d5c4377b91b4b79963fe4aeb348fcbe` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:47.221012 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5c4377b91b4b79963fe4aeb348fcbe)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:47.223197 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:47.282532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5c4377b91b4b79963fe4aeb348fcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.296146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5c4377b91b4b79963fe4aeb348fcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.297380 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5c4377b91b4b79963fe4aeb348fcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.321216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5c4377b91b4b79963fe4aeb348fcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.333296 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5c4377b91b4b79963fe4aeb348fcbe'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.342963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1416/2834] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:47 2022] DELETE /identity/v3/users/3d5c4377b91b4b79963fe4aeb348fcbe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:47.618200 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:47.670149 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d324-313e-4084-bd8b-22ee36dd919d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:47.745231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:47.746052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:47.746336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:47.746694 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] PATH_INFO: `/v3/projects/78aba8d584ee429ebf7fc76f9dac885f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:47.749120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aba8d584ee429ebf7fc76f9dac885f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:47.752490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:47.843939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aba8d584ee429ebf7fc76f9dac885f', 'request_id': 'req-1645b3b4-a554-400d-bfff-45d9a94a40cc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.856118 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aba8d584ee429ebf7fc76f9dac885f', 'request_id': 'req-1645b3b4-a554-400d-bfff-45d9a94a40cc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.866263 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aba8d584ee429ebf7fc76f9dac885f', 'request_id': 'req-1645b3b4-a554-400d-bfff-45d9a94a40cc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.879962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] The token cache is being invalidate because project 78aba8d584ee429ebf7fc76f9dac885f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:47.880443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.881699 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:47.884508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1419/2835] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:47 2022] DELETE /identity/v3/projects/78aba8d584ee429ebf7fc76f9dac885f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:47.890062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:47.892283 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:47.917353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e6d8-8ce8-43bc-8762-704f867df54a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:47.990818 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:47.991466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:47.991746 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:47.992044 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] PATH_INFO: `/v3/users/20336c154fb54062b06d77c00f8e2f8c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:47.993251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20336c154fb54062b06d77c00f8e2f8c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:47.995437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:48.010274 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:48.073622 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20336c154fb54062b06d77c00f8e2f8c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.083879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20336c154fb54062b06d77c00f8e2f8c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.084509 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20336c154fb54062b06d77c00f8e2f8c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.103758 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20336c154fb54062b06d77c00f8e2f8c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.113268 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fbea0b6c-6bb1-4328-8030-999d31a3f58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20336c154fb54062b06d77c00f8e2f8c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.120176 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1417/2836] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:47 2022] DELETE /identity/v3/users/20336c154fb54062b06d77c00f8e2f8c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:48.327108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:48.328692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:48.347633 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b3b4-a554-400d-bfff-45d9a94a40cc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:48.416367 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:48.417399 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:48.417911 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:48.418369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] PATH_INFO: `/v3/projects/baee9142727d491c8b06d6f7144c57b5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:48.420759 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] RBAC: Authorizing `identity:delete_project(project_id=baee9142727d491c8b06d6f7144c57b5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:48.424230 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:48.451069 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:48.490352 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baee9142727d491c8b06d6f7144c57b5', 'request_id': 'req-294011cc-79d2-457b-80af-5e8f5320526a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.506700 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baee9142727d491c8b06d6f7144c57b5', 'request_id': 'req-294011cc-79d2-457b-80af-5e8f5320526a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.515049 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baee9142727d491c8b06d6f7144c57b5', 'request_id': 'req-294011cc-79d2-457b-80af-5e8f5320526a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.538588 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] The token cache is being invalidate because project baee9142727d491c8b06d6f7144c57b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:48.538897 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.539533 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-294011cc-79d2-457b-80af-5e8f5320526a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:48.541051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1420/2837] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:48 2022] DELETE /identity/v3/projects/baee9142727d491c8b06d6f7144c57b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:48.549230 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:48.549918 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:48.550589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:48.652207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:48.654708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:48.762485 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1418/2838] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:48.774440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:48.775024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:48.775579 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:48.802440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:48.803692 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:48.812876 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1421/2839] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:48.817271 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:48.828333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1511b-1d69-430f-bf72-82f265a578d8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:48.834810 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:48.835861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:48.836249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:48.836898 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:48.837825 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:48.838265 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:48.842135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:48.856487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1419/2840] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:48.862177 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:48.874244 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a166-5845-4171-8c1c-2f5724469783 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:48.879967 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:48.880996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:48.880996 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:48.881427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:48.881821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:48.883932 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:48.924254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1422/2841] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:48 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 13:07:48.928865 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:48.939707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c104-7f33-4d6a-a5cd-6fc92dff19f3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.009368 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:49.031066 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.031607 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.031889 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.032166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.033119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.035295 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:49.065575 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1420/2842] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:48 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:49.070446 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:49.085753 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f626590-12e1-4018-ac74-091209fee021 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.097061 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.097840 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.098193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.099077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.111981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.114936 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:49.134904 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1423/2843] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:49.139960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:49.157451 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37357059-2823-4fae-b6c0-b7e296e146a3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.163088 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.163791 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.164135 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.164469 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.165184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.166887 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3a5f-a6cc-4d0c-a848-caecb0bebbfe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:49.183695 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1421/2844] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:49.190858 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:49.202365 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5148-c498-4d3d-9ff2-40295bb7a334 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.208491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.209460 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.209918 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.210354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] PATH_INFO: `/v3/projects/d3aef04292244e46a1f3b946a3fd2f80/users/244bad1f727447e2a2db7b49887fe485/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.234343 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3aef04292244e46a1f3b946a3fd2f80, user_id=244bad1f727447e2a2db7b49887fe485, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.237834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:49.254010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1424/2845] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:49 2022] PUT /identity/v3/projects/d3aef04292244e46a1f3b946a3fd2f80/users/244bad1f727447e2a2db7b49887fe485/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:49.265466 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.265841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.266115 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.305407 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] MFA Rules not processed for user `244bad1f727447e2a2db7b49887fe485`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:49.306548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:49.419848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1422/2846] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:49.438555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:49.440905 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:49.543274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8fe7-fadf-49ca-abbf-1c94ce60e3e4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.554573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.555823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.556241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.557313 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.574496 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.578900 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c9aaa-b24d-4995-b987-75cd9a5f6335 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:49.598339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1425/2847] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:49.768433 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:49.770429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:49.925685 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854ee5-fcdb-4702-a2cd-134260605975 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:49.933974 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:49.935927 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:49.936824 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:49.937709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] PATH_INFO: `/v3/users/4d8e2481260c45218bd229002612efd3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:49.939795 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8e2481260c45218bd229002612efd3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:49.944716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:50.029524 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8e2481260c45218bd229002612efd3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:50.042091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8e2481260c45218bd229002612efd3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:50.042091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8e2481260c45218bd229002612efd3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:50.042802 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:50.063813 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8e2481260c45218bd229002612efd3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:50.074589 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8e2481260c45218bd229002612efd3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:50.084226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1423/2848] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:49 2022] DELETE /identity/v3/users/4d8e2481260c45218bd229002612efd3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:50.088060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d89619-d101-41da-9a13-5b8a1133f317 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:50.089518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d89619-d101-41da-9a13-5b8a1133f317 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:50.090181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d89619-d101-41da-9a13-5b8a1133f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:50.148764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-85d89619-d101-41da-9a13-5b8a1133f317 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:50.150176 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-85d89619-d101-41da-9a13-5b8a1133f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:50.187772 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:50.257302 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1426/2849] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:50.271794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:50.273335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:50.374679 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9173be6-2434-4b22-b653-e42555624ad0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:50.383935 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:50.385034 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:50.385529 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:50.386020 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:50.405028 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:50.407367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:50.421689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1424/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:50.508020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fcf3b-a2f8-4cc5-9f94-124bd234c740 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:50.508507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fcf3b-a2f8-4cc5-9f94-124bd234c740 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:50.509004 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fcf3b-a2f8-4cc5-9f94-124bd234c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:50.548364 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-982fcf3b-a2f8-4cc5-9f94-124bd234c740 None None] MFA Rules not processed for user `eec35880c13f4cc3bbc7cb932f96742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:50.550940 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-982fcf3b-a2f8-4cc5-9f94-124bd234c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:50.630555 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1427/2851] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:51.191333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.192538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:51.235861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3ab6f-1735-4fad-92d9-7fb79ee5c4eb service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.245249 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.246945 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.248293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.249158 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] PATH_INFO: `/v3/projects/e340a1a8fadf45609bb219c58b860de5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.251980 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e340a1a8fadf45609bb219c58b860de5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.257256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.355180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e340a1a8fadf45609bb219c58b860de5', 'request_id': 'req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:51.370768 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e340a1a8fadf45609bb219c58b860de5', 'request_id': 'req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:51.385930 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e340a1a8fadf45609bb219c58b860de5', 'request_id': 'req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:51.409437 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] The token cache is being invalidate because project e340a1a8fadf45609bb219c58b860de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:51.409960 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:51.411246 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cb7501e5-fa6a-4312-9bd2-73cc2a1f47d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:51.413392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1425/2852] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:51 2022] DELETE /identity/v3/projects/e340a1a8fadf45609bb219c58b860de5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:51.422355 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.425731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.426470 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.463181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:51.465301 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:51.578723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1428/2853] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:51.587946 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.588546 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.588891 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.612753 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:51.614058 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:51.627204 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1426/2854] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:51.632299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.648667 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2c83-b50c-4081-b3bb-019e3a704eef None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.656148 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.657088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.657891 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.658271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.659056 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:51.659491 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.661465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.675581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1429/2855] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:07:51.682003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.693590 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f2fc4-1f1a-476e-835c-2c724db7965f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.698631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.699250 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.699523 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.699792 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.700483 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.702454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.746031 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1427/2856] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:51 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:51.752231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.770495 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024ff3c-22a9-4c2a-8dc2-c1ca6943e44b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.864241 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.864871 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.865189 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.865573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.866101 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.868040 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.877174 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:51.898034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1430/2857] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:51 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:51.899838 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.914551 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137d81-69e7-423c-a4eb-ff39d21c87a9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.921261 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.922076 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.922459 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.922857 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.923619 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.925474 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.937966 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1428/2858] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:51.942705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.955178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5bad-9061-4460-b5b9-77c9746d1aee admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:51.960878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:51.961741 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:51.962144 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:51.963489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:51.963489 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:51.966989 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f0e0a-a73f-4243-9766-2805306edc8c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:51.978836 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1431/2859] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:51.984979 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:51.999079 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa75d-bb01-4fc3-95b4-eefbbb4b13eb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:52.005147 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:52.005995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:52.006385 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:52.006764 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] PATH_INFO: `/v3/projects/c4ed12c2f7e54f3796ddd91958637319/users/b82a3be3ee214ae3b2028edafaa4431e/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:52.025967 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ed12c2f7e54f3796ddd91958637319, user_id=b82a3be3ee214ae3b2028edafaa4431e, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:52.028742 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:52.033062 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:52.049049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1429/2860] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:51 2022] PUT /identity/v3/projects/c4ed12c2f7e54f3796ddd91958637319/users/b82a3be3ee214ae3b2028edafaa4431e/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:52.061690 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:52.062095 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:52.062576 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:52.109870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] MFA Rules not processed for user `b82a3be3ee214ae3b2028edafaa4431e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:52.113315 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:52.225581 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1432/2861] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:52.236704 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:52.239101 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:52.310293 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa10cac-c9fb-44c3-a524-d088a3a1500c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:52.314723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:52.315344 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:52.315621 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:52.315896 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:52.328567 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:52.330180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:52.341413 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1430/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:52.441182 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:52.443408 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:52.563497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:52.566138 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:52.590664 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd7328-8adb-4d04-8077-9dc0898de083 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:52.609183 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:52.610341 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:52.618080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:52.618080 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:52.620079 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:52.639327 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:52.641906 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc76e5e-742d-42d6-85d7-ae23dd6d59e4 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:52.665934 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1433/2863] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:07:52.691755 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403305fc-fec3-4c75-b094-200d64266de2 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:52.698071 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:52.699151 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:52.699645 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:52.700243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] PATH_INFO: `/v3/users/244bad1f727447e2a2db7b49887fe485` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:52.703184 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244bad1f727447e2a2db7b49887fe485)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:52.707335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:52.932721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244bad1f727447e2a2db7b49887fe485'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:52.944506 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244bad1f727447e2a2db7b49887fe485'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:52.945601 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244bad1f727447e2a2db7b49887fe485'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:52.970166 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244bad1f727447e2a2db7b49887fe485'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:52.981640 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244bad1f727447e2a2db7b49887fe485'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:52.995771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1431/2864] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:07:52 2022] DELETE /identity/v3/users/244bad1f727447e2a2db7b49887fe485 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:53.002221 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:53.002693 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:53.003155 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:53.036631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:53.038886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:53.104420 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:53.141553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1434/2865] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:53.152405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:53.155179 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:53.179996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:53.235504 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164fd29-bff7-490f-b84c-d629454eb844 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:53.240612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:53.241247 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:53.241530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:53.241811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:53.255954 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:53.257937 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023c870-b63c-4a14-bab1-99ab4a37b7f9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:53.269131 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1432/2866] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:07:53.722637 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:53.724865 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:53.751465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046b2a-32f5-4db4-99a0-03666491bda4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:53.758111 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:53.759255 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:53.759997 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:53.760765 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] PATH_INFO: `/v3/projects/d3aef04292244e46a1f3b946a3fd2f80` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:53.762398 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3aef04292244e46a1f3b946a3fd2f80)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:53.765781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:53.858796 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3aef04292244e46a1f3b946a3fd2f80', 'request_id': 'req-981c7f9c-9712-4747-96eb-834005966c4c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:53.872886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3aef04292244e46a1f3b946a3fd2f80', 'request_id': 'req-981c7f9c-9712-4747-96eb-834005966c4c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:53.883051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3aef04292244e46a1f3b946a3fd2f80', 'request_id': 'req-981c7f9c-9712-4747-96eb-834005966c4c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:53.903843 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] The token cache is being invalidate because project d3aef04292244e46a1f3b946a3fd2f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:07:53.904273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:53.905100 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-981c7f9c-9712-4747-96eb-834005966c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:07:53.907043 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1435/2867] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:07:53 2022] DELETE /identity/v3/projects/d3aef04292244e46a1f3b946a3fd2f80 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:07:53.913733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:53.913733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:53.913733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:53.936349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:53.937643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:54.064347 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1433/2868] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:07:54.089035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.115809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.116437 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.157870 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:54.159907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:54.171368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1436/2869] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:54.178677 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.196884 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bcbbe-e775-4873-b0ee-822d61b4a0b2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.206717 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.207988 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.209285 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.209856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.211013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:07:54.211452 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.214119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.241548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1434/2870] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 13:07:54.246007 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.272607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1985d-0c6f-44c0-931d-a5fbe7389153 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.285595 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.286571 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.287021 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.287551 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.288515 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.291122 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.339848 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1437/2871] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:07:54 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:54.342361 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.357219 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88b19-a31e-41f6-abff-7b46a2866cd9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.468747 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.469709 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.469994 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.470254 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.470907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.472878 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.500732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1435/2872] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:07:54 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:07:54.506802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.525990 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1cfbf-13ee-4a1c-b87b-467571276e7d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.533654 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.534826 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.535467 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.535756 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.536616 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.539880 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.556498 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1438/2873] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:07:54.562848 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.580165 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7a860-57e2-4b7c-a6bd-264fea4815ab admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.585226 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.585871 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.586154 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.586723 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.587210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.588763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9980fd-0598-498d-a11e-7f0b8419664e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.600531 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1436/2874] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:07:54.605443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.618798 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59cb30-2b43-4f3f-a758-a874bc035816 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.626548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.627573 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.627953 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.628299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] PATH_INFO: `/v3/projects/07e5b9a1f594409f978bad8c4763241e/users/d6f7ebd256614ca4ae0efbc43cb4aee5/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.652670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e5b9a1f594409f978bad8c4763241e, user_id=d6f7ebd256614ca4ae0efbc43cb4aee5, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.658229 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.683358 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1439/2875] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:07:54 2022] PUT /identity/v3/projects/07e5b9a1f594409f978bad8c4763241e/users/d6f7ebd256614ca4ae0efbc43cb4aee5/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:07:54.701587 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.702210 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.702772 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.751886 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] MFA Rules not processed for user `d6f7ebd256614ca4ae0efbc43cb4aee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:07:54.753152 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:54.768541 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:54.845089 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1437/2876] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:07:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:07:54.860808 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:07:54.863485 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:07:54.951614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048a0e5-f0c1-4b01-b9a6-399dc27e09ba admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:07:54.957033 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce3ffcb22c2e4dfe8d9341d82c8bb716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:07:54.957907 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:07:54.958252 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:07:54.958597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:07:54.968642 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:07:54.970179 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a848d-27ba-4e97-b880-262c03c4e222 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:07:54.975620 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:54.981461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1440/2877] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:07:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:00.830231 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:00.935242 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5becb5e-fdc1-4c01-86d9-3ce6c69bafe4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:00.941375 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:00.942335 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:00.942820 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:00.943289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] PATH_INFO: `/v3/users/d6f7ebd256614ca4ae0efbc43cb4aee5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:00.945206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f7ebd256614ca4ae0efbc43cb4aee5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:00.947484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:01.000050 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f7ebd256614ca4ae0efbc43cb4aee5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.016124 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f7ebd256614ca4ae0efbc43cb4aee5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.016919 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f7ebd256614ca4ae0efbc43cb4aee5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.033718 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f7ebd256614ca4ae0efbc43cb4aee5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.042255 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f7ebd256614ca4ae0efbc43cb4aee5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.052861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1438/2878] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:08:00 2022] DELETE /identity/v3/users/d6f7ebd256614ca4ae0efbc43cb4aee5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:01.059035 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:01.060518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:01.060518 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:01.091072 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:01.093086 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:01.186124 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1441/2879] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:08:01.196616 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:01.198059 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:01.249367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:01.285689 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb5176-ae98-4b3b-b49b-c38a64f60669 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:01.292771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:01.293390 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:01.294352 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:01.294676 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:01.305338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:01.306835 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:01.320663 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1439/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:01.717631 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:01.719381 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:01.735617 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eff44-3c51-47cb-ad44-e93ca727af36 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:01.741884 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:01.742980 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:01.743490 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:01.744078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] PATH_INFO: `/v3/projects/07e5b9a1f594409f978bad8c4763241e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:01.745402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e5b9a1f594409f978bad8c4763241e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:01.748834 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:01.811770 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e5b9a1f594409f978bad8c4763241e', 'request_id': 'req-000b095a-aa47-4bda-bcb3-ed66a9b88c65'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.820946 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e5b9a1f594409f978bad8c4763241e', 'request_id': 'req-000b095a-aa47-4bda-bcb3-ed66a9b88c65'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.831557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e5b9a1f594409f978bad8c4763241e', 'request_id': 'req-000b095a-aa47-4bda-bcb3-ed66a9b88c65'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.843106 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] The token cache is being invalidate because project 07e5b9a1f594409f978bad8c4763241e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:08:01.843375 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.844054 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-000b095a-aa47-4bda-bcb3-ed66a9b88c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:01.845605 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1442/2881] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:08:01 2022] DELETE /identity/v3/projects/07e5b9a1f594409f978bad8c4763241e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:03.645013 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:03.647461 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:03.672990 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7de2c-8fcc-4326-9a54-c1f243e5acf0 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:03.765526 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:03.766288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:03.767286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:03.767286 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] PATH_INFO: `/v3/users/b82a3be3ee214ae3b2028edafaa4431e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:03.768547 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82a3be3ee214ae3b2028edafaa4431e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:03.770738 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:03.849405 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82a3be3ee214ae3b2028edafaa4431e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:03.860518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82a3be3ee214ae3b2028edafaa4431e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:03.861178 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82a3be3ee214ae3b2028edafaa4431e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:03.882084 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82a3be3ee214ae3b2028edafaa4431e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:03.897338 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82a3be3ee214ae3b2028edafaa4431e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:03.912041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1440/2882] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:08:03 2022] DELETE /identity/v3/users/b82a3be3ee214ae3b2028edafaa4431e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:03.920802 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:03.921714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:03.921939 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:03.955368 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:03.957665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:04.065023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1443/2883] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:04.079703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:04.079703 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:04.175009 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:04.196899 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b850d5-0bd0-4790-a209-e2e09d250a39 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:04.201212 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:04.201864 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:04.202149 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:04.202421 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:04.213639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:04.216206 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae9ed7-ba3d-4ecd-9648-bd9ad205752c service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:04.231476 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1441/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:04.663764 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:04.665709 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:04.680983 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40bd0-86f1-4ff7-b46d-a755069ab952 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:04.687471 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:04.688041 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:04.688317 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:04.688597 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] PATH_INFO: `/v3/projects/c4ed12c2f7e54f3796ddd91958637319` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:04.689829 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ed12c2f7e54f3796ddd91958637319)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:04.691779 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:04.724318 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:04.761811 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ed12c2f7e54f3796ddd91958637319', 'request_id': 'req-3abdc93a-7a42-46bf-90dc-bce53546f461'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:04.770256 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ed12c2f7e54f3796ddd91958637319', 'request_id': 'req-3abdc93a-7a42-46bf-90dc-bce53546f461'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:04.776903 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ed12c2f7e54f3796ddd91958637319', 'request_id': 'req-3abdc93a-7a42-46bf-90dc-bce53546f461'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:04.794956 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] The token cache is being invalidate because project c4ed12c2f7e54f3796ddd91958637319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:08:04.795443 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:04.796468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:04.798950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1444/2885] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:08:04 2022] DELETE /identity/v3/projects/c4ed12c2f7e54f3796ddd91958637319 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:08.591915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8781af-eceb-4ac9-9ffc-88ccda76a368 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:08.592965 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8781af-eceb-4ac9-9ffc-88ccda76a368 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:08.593631 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8781af-eceb-4ac9-9ffc-88ccda76a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:08.643073 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0a8781af-eceb-4ac9-9ffc-88ccda76a368 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:08.644653 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0a8781af-eceb-4ac9-9ffc-88ccda76a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:08.741624 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1442/2886] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:08.806289 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:08.808414 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:08.901647 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc93a-7a42-46bf-90dc-bce53546f461 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:08.908013 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:08.908649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:08.909024 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:08.909207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:08.922051 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:08.924462 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:08.938344 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1445/2887] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 13:08:18.722298 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=41 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:18.935541 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:25.476613 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:25.477142 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:25.477276 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:25.497392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] MFA Rules not processed for user `fcdafb2881494434ae9e742a103117bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:25.498660 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:25.506707 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1443/2888] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:25.521032 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:25.536750 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ea528-9bd8-4314-bb6c-acff4e7d3a70 service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:25.542067 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f1d6fdb382403cb9b9d4c60cf582bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:25.543245 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:25.543520 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:25.543888 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:25.554619 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:25.557010 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:25.570280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1446/2889] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 13:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 13:08:27.635721 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:27.637429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:27.711256 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91e04-2a5e-4e3e-ab6f-97cb728b39c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:27.716693 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:27.717329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:27.717650 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:27.717932 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] PATH_INFO: `/v3/users/eec35880c13f4cc3bbc7cb932f96742b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:27.720726 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec35880c13f4cc3bbc7cb932f96742b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:27.723416 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:27.782852 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec35880c13f4cc3bbc7cb932f96742b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:27.793264 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec35880c13f4cc3bbc7cb932f96742b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:27.794410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec35880c13f4cc3bbc7cb932f96742b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:27.807664 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec35880c13f4cc3bbc7cb932f96742b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:27.815831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b25169b0-c97c-4f51-b375-1c1a83f73f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec35880c13f4cc3bbc7cb932f96742b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:27.821964 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1444/2890] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:08:27 2022] DELETE /identity/v3/users/eec35880c13f4cc3bbc7cb932f96742b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:08:28.012539 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.029809 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373abd-19c7-4c91-979b-44c815d7a8cd service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.095909 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.096554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.096844 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.097116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] PATH_INFO: `/v3/projects/4f53ebda32884b39925693bcdcfaf95d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.098328 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f53ebda32884b39925693bcdcfaf95d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.100274 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.155608 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f53ebda32884b39925693bcdcfaf95d', 'request_id': 'req-e50564f4-d43a-4706-9c24-07a7c8aecdb5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:28.164214 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f53ebda32884b39925693bcdcfaf95d', 'request_id': 'req-e50564f4-d43a-4706-9c24-07a7c8aecdb5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:28.172965 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f53ebda32884b39925693bcdcfaf95d', 'request_id': 'req-e50564f4-d43a-4706-9c24-07a7c8aecdb5'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:28.185271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] The token cache is being invalidate because project 4f53ebda32884b39925693bcdcfaf95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:08:28.185569 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:28.186060 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e50564f4-d43a-4706-9c24-07a7c8aecdb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:28.187552 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1447/2891] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:08:28 2022] DELETE /identity/v3/projects/4f53ebda32884b39925693bcdcfaf95d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:28.192503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.192775 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.193049 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.214478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:28.215641 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:28.276929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1445/2892] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:28.285992 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.286275 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.286550 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.307045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:28.309037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:28.317091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1448/2893] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 13:08:28.321372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.332510 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019eba8-ddd8-4df1-b0f3-86d47dde93bf None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.337202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.337836 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.338123 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.338397 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.339053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:08:28.339522 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.341426 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.350929 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:28.355336 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1446/2894] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:08:28.361039 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.376178 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc96-663c-4b3b-906a-c1aea4f7d018 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.382347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.382950 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.383225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.383494 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.384146 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.386125 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.418722 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1449/2895] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:08:28 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:28.422749 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.435694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308258af-8cba-4888-8d9e-e892302d5477 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.499456 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.500069 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.500345 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.500615 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.501290 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.503270 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.531187 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1447/2896] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:08:28 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:28.535747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.546862 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3ea8-3b28-46a4-9bfa-a80372a88f85 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.551630 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.552236 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.552513 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.552944 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.553427 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.555073 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.566536 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1450/2897] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:08:28.570626 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.581232 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a8a-aa34-4e1c-8dff-1e3dc5be955c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.586559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.587202 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.587482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.587756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.588412 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.590632 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be367fc-ee47-41a4-a35a-b70106f6f1bc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.603121 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1448/2898] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:08:28.608353 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.618665 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b43cc-a584-43fa-935b-3a04a4f4d6d9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.623780 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.624430 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.624723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.624994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] PATH_INFO: `/v3/projects/fa33d7981b694e2982a0526cb0496067/users/8bff49ed1a13434896ad9d18c966f8a7/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.642748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa33d7981b694e2982a0526cb0496067, user_id=8bff49ed1a13434896ad9d18c966f8a7, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.647247 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.665128 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1451/2899] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:08:28 2022] PUT /identity/v3/projects/fa33d7981b694e2982a0526cb0496067/users/8bff49ed1a13434896ad9d18c966f8a7/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:28.677568 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.678446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.678669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.709243 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] MFA Rules not processed for user `8bff49ed1a13434896ad9d18c966f8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:28.710484 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:28.778654 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1449/2900] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:28.789696 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:28.791461 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:28.806942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:28.856913 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a646e79-f1a0-4141-bceb-abd3b32e7854 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:28.860743 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8d2a225934b7686b885ec53c71ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:28.861354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:28.861678 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:28.861972 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:28.871807 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:28.873324 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0fc7-1790-4b91-93ea-8912b8f58463 service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:28.882593 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1452/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:38.774441 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:38.878438 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=20 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:50.881706 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:50.944480 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae948-a171-412e-a9eb-467a94c4bc4d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:50.949349 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:50.950001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:50.950281 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:50.950554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] PATH_INFO: `/v3/users/8bff49ed1a13434896ad9d18c966f8a7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:50.951690 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bff49ed1a13434896ad9d18c966f8a7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:50.953646 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.009800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bff49ed1a13434896ad9d18c966f8a7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.018543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bff49ed1a13434896ad9d18c966f8a7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.019193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bff49ed1a13434896ad9d18c966f8a7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.031538 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bff49ed1a13434896ad9d18c966f8a7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.038482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bff49ed1a13434896ad9d18c966f8a7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.044917 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1450/2902] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:08:50 2022] DELETE /identity/v3/users/8bff49ed1a13434896ad9d18c966f8a7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:51.049382 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.049955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.049955 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.068749 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:51.070278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:51.129012 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1453/2903] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:51.138894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.140302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:51.198638 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a1a0b-5d9f-47f4-a93a-72b1a6f3d542 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.202303 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.202907 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.203189 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.203463 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.212808 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.215440 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687d54-eead-4b8d-9d7b-d84ef406385c service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.224879 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1451/2904] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:51.495641 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.497212 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:51.509190 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8ca29-dfa4-4e24-be26-87b43ec9b1d2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.514113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.514738 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.515020 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.515295 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] PATH_INFO: `/v3/projects/fa33d7981b694e2982a0526cb0496067` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.516433 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa33d7981b694e2982a0526cb0496067)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.518423 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.569078 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa33d7981b694e2982a0526cb0496067', 'request_id': 'req-cd828893-2711-41be-8477-8a707d3abcae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.585921 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa33d7981b694e2982a0526cb0496067', 'request_id': 'req-cd828893-2711-41be-8477-8a707d3abcae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.594761 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa33d7981b694e2982a0526cb0496067', 'request_id': 'req-cd828893-2711-41be-8477-8a707d3abcae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.606332 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] The token cache is being invalidate because project fa33d7981b694e2982a0526cb0496067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:08:51.606638 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.607276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cd828893-2711-41be-8477-8a707d3abcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:08:51.608785 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1454/2905] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:08:51 2022] DELETE /identity/v3/projects/fa33d7981b694e2982a0526cb0496067 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:51.613986 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.614266 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.614535 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.634464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:51.635915 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:51.653107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:51.698559 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1452/2906] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:51.707994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.708276 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.708548 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.731406 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:51.732613 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:51.740504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1455/2907] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:51.744785 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.754586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99479-fc27-4594-8235-421df459fe34 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.759216 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.759816 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.760099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.760372 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.761140 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 13:08:51.761443 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.763046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.774665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1453/2908] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 13:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 13:08:51.779659 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.789530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4df89-89f3-4060-93cf-af462b7c719b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.794887 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.795474 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.795751 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.796023 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.797180 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.799089 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.828994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1456/2909] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:08:51 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:51.833233 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.843333 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66cd3-a2fe-45f4-8898-2b458882d0b2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.900801 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.901530 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.901744 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.901890 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.902487 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.904418 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.926080 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1454/2910] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:08:51 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:51.930339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.940981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023dd26-7526-443d-8663-2cf5a542782b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.945615 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.946193 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.946468 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.946735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.947363 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.949923 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.961045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1457/2911] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:08:51.965193 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:51.974922 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db8e1-0bcd-49ea-bfa2-d5d11718ca22 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:51.979430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:51.980014 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:51.980289 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:51.980558 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:51.981192 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:51.982797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca6c83-5038-447b-a8e4-cf38c050fa4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:51.993017 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1455/2912] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:08:51.997977 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:52.007684 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e39bfe-1880-4c1b-950e-705d9df8d478 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:52.012926 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:52.013599 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:52.013872 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:52.014142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] PATH_INFO: `/v3/projects/394ac30983e848c697736df1907f8c39/users/364cd6e55c32470b9c3b4c58896a948c/roles/770fbbc02ae64fba9fac93fc4d59328a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:52.028112 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394ac30983e848c697736df1907f8c39, user_id=364cd6e55c32470b9c3b4c58896a948c, role_id=770fbbc02ae64fba9fac93fc4d59328a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:52.030769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:52.044553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1458/2913] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:08:51 2022] PUT /identity/v3/projects/394ac30983e848c697736df1907f8c39/users/364cd6e55c32470b9c3b4c58896a948c/roles/770fbbc02ae64fba9fac93fc4d59328a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:08:52.049708 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f990e2-60a7-4c9d-bc52-3bf5c62155f3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:52.049995 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f990e2-60a7-4c9d-bc52-3bf5c62155f3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:52.050454 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f990e2-60a7-4c9d-bc52-3bf5c62155f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:52.069696 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b9f990e2-60a7-4c9d-bc52-3bf5c62155f3 None None] MFA Rules not processed for user `fe6635e8dd81449693cd6bc25f154f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:52.070894 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b9f990e2-60a7-4c9d-bc52-3bf5c62155f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:52.133643 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1456/2914] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:52.143547 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:52.145339 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:52.169052 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:52.208519 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57164-ef2e-428f-a637-98ffa8cf05e1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:52.212196 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:52.212793 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:52.213113 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:52.213624 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:52.222663 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:52.224084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:52.234096 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1459/2915] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:08:56.672343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:56.673259 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:56.673794 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:56.717705 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] MFA Rules not processed for user `364cd6e55c32470b9c3b4c58896a948c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:08:56.719497 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:08:56.747628 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:56.816251 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1457/2916] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:08:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:08:56.820943 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:56.832116 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728304f-6123-4822-b414-b2af28a80a06 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:56.842650 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:56.843278 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:56.843553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:56.843821 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:56.844504 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:56.846458 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:56.887584 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1460/2917] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 13:08:56 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:56.892367 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:56.907739 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe7fd-bafd-42a7-9f65-e5af20d78b06 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:56.970712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:56.971299 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:56.972205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:56.972482 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:56.973113 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:56.975053 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:56.997203 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1458/2918] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 13:08:56 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 13:08:57.001810 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:57.017158 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c86c9-9619-4cc9-a037-05af7a6965bd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:57.023747 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:57.024557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:57.024878 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:57.025084 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:57.026304 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:57.028160 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:57.040034 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1461/2919] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 13:08:57.045091 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:57.055582 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee43230-e7f2-4d63-9971-81be3c115313 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:57.060840 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:57.061543 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:57.061823 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:57.062096 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] PATH_INFO: `/v3/projects/936907d4d18e47b580a7bd6ae31305b9/users/15d9d56de3b04ae99bca1da9c97339b8/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:57.080985 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936907d4d18e47b580a7bd6ae31305b9, user_id=15d9d56de3b04ae99bca1da9c97339b8, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:57.083756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:57.101667 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1459/2920] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:08:57 2022] PUT /identity/v3/projects/936907d4d18e47b580a7bd6ae31305b9/users/15d9d56de3b04ae99bca1da9c97339b8/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 13:08:57.109607 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:57.124139 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7135-aa7f-41f2-80b0-a07bde5d44ce admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:57.204748 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:57.205369 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:57.205705 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:57.205986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:57.206634 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:57.208553 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe49f-de5b-4138-a59d-62ac0b7a82f5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:57.220059 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1462/2921] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 13:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 13:08:57.225099 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:08:57.236492 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66b7b-dd1e-4e91-bccb-21e0a5d1cf56 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:08:57.241146 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:08:57.241831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:08:57.242110 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:08:57.242392 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] PATH_INFO: `/v3/projects/936907d4d18e47b580a7bd6ae31305b9/users/15d9d56de3b04ae99bca1da9c97339b8/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:08:57.244819 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936907d4d18e47b580a7bd6ae31305b9, user_id=15d9d56de3b04ae99bca1da9c97339b8, role_id=5e30cfc1aef04f26bfd6a0777b2c4ae8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:08:57.247494 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:08:57.258880 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1460/2922] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 13:08:57 2022] PUT /identity/v3/projects/936907d4d18e47b580a7bd6ae31305b9/users/15d9d56de3b04ae99bca1da9c97339b8/roles/5e30cfc1aef04f26bfd6a0777b2c4ae8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:09:01.973469 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32244c-31df-437e-bb49-12ee76383327 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:09:01.974045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32244c-31df-437e-bb49-12ee76383327 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:09:01.974045 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32244c-31df-437e-bb49-12ee76383327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:09:02.006557 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0e32244c-31df-437e-bb49-12ee76383327 None None] MFA Rules not processed for user `15d9d56de3b04ae99bca1da9c97339b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:09:02.007778 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e32244c-31df-437e-bb49-12ee76383327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:09:02.086455 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1463/2923] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:09:02.108658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:09:02.110821 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:09:02.193258 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:02.225116 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36c52-c7d6-4aa7-a59e-9c8d23513b74 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:09:02.232756 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:09:02.233329 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:09:02.233657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:09:02.233901 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:09:02.304563 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:09:02.306205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:09:02.318669 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1461/2924] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:09:03.427731 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:09:03.428266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:09:03.428266 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:09:03.450281 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] MFA Rules not processed for user `364cd6e55c32470b9c3b4c58896a948c`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:09:03.451527 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:09:03.458556 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1464/2925] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 13:09:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:09:12.313332 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=33 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:13.442389 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:27.655018 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:09:27.656800 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:09:27.717518 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180b2d-80bf-4b41-b84b-f82cf5f3e31f service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:09:27.721288 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:09:27.721916 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:09:27.722191 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:09:27.722554 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:09:27.732976 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:09:27.734429 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:09:27.744399 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1462/2926] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:09:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:09:37.739811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=26 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:53.849632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:10:53.861735 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4908-71ca-4da8-b20d-0ed72d2075e4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:10:53.866120 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:10:53.866773 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:10:53.867264 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:10:53.867598 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:10:53.869181 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:10:53.882115 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:10:53.883586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:10:53.893589 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1465/2927] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:11:03.890088 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:11:24.818588 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:24.830583 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01366b-2953-418d-bebd-99f6d0394bab service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:24.834657 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:24.835282 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:24.835562 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:24.835831 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:24.837885 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:24.852733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:24.854209 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edeb27-3ef0-4190-8f50-66db63128bdf service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:24.867464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1463/2928] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:11:26.095538 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:26.107234 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cabee6-f165-42f0-990e-11f64aa5c757 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:26.111554 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:26.112166 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:26.112452 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:26.112755 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:26.114632 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:26.130445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:26.132027 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4a726-e8eb-4749-bf9f-6a6be9940dc5 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:26.145949 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1466/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:11:34.861658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:11:36.139833 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:11:38.630180 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb795-f848-4adf-9dcd-2cb64041efce None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.631164 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb795-f848-4adf-9dcd-2cb64041efce None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.631644 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb795-f848-4adf-9dcd-2cb64041efce None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.633446 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1464/2930] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 13:11:38.640280 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d502f-cdb0-4789-aeb9-4923e7ffa442 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.640841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d502f-cdb0-4789-aeb9-4923e7ffa442 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.640841 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d502f-cdb0-4789-aeb9-4923e7ffa442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.692614 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c99d502f-cdb0-4789-aeb9-4923e7ffa442 None None] MFA Rules not processed for user `68ab75cd2b8f48b7967923b3f875b6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:11:38.694208 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c99d502f-cdb0-4789-aeb9-4923e7ffa442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:38.702649 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1467/2931] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:11:38.718586 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb795-f848-4adf-9dcd-2cb64041efce None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:38.730665 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb795-f848-4adf-9dcd-2cb64041efce None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:38.734972 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:38.735581 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.736041 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.736499 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.745019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:38.747047 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c6203-ef4c-4787-a316-3f5070734aa3 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:38.758733 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1465/2932] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 13:11:38.858231 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4fee-681b-460a-b5f3-bc48893bce38 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.858517 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4fee-681b-460a-b5f3-bc48893bce38 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.858804 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4fee-681b-460a-b5f3-bc48893bce38 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.860142 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1468/2933] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 13:11:38.866262 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.866539 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.866809 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.906841 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] MFA Rules not processed for user `e4e7f0ac2d354e1eac91ab2b91e5a89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 13:11:38.908297 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:38.918811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1466/2934] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 13:11:38.930336 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa4fee-681b-460a-b5f3-bc48893bce38 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:38.944570 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa4fee-681b-460a-b5f3-bc48893bce38 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:38.948103 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ab75cd2b8f48b7967923b3f875b6db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:38.948702 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:38.948994 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:38.949254 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:38.959942 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:38.961379 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:38.972723 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1469/2935] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:11:39.037584 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:39.038963 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:39.119037 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b536-741d-4433-a44b-daa2c79e0c11 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:39.125391 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:39.126054 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:39.126339 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:39.126606 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:39.128591 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:39.140827 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:39.142532 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:39.153797 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1467/2936] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:11:41.476211 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:11:41.477827 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:41.493886 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1e469-4e6e-4a68-8f91-4c9c38b311d7 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:11:41.500537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:11:41.501167 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:11:41.501445 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:11:41.501762 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:11:41.503590 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:11:41.518299 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:11:41.519979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:11:41.532925 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1470/2937] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:11:49.148811 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=47 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:11:51.527147 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=21 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:56.729712 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:12:56.766658 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579770-1a7b-4285-be11-1243fa4a49ad service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:12:56.773245 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e7f0ac2d354e1eac91ab2b91e5a89b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:12:56.774001 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:12:56.774430 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:12:56.774724 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:12:56.778019 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:12:56.794207 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:12:56.794788 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:12:56.808061 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1468/2938] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:12:59.652162 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:12:59.654629 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:12:59.680354 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753f65-488c-448a-8e7f-8a19c2da6cbb service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:12:59.689271 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:12:59.690107 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:12:59.690449 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:12:59.690823 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:12:59.692937 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:12:59.713347 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:12:59.715465 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:12:59.727970 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1471/2939] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:13:05.467046 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:05.479394 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a922-45a7-44dd-b49a-6f94f3977d63 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:05.485996 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:05.486635 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:05.486914 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:05.487185 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:05.489051 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:13:05.502464 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:05.504934 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:05.519573 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1469/2940] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:13:09.157919 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:09.170243 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc3f5-944e-4cd8-97dd-a0aed36cd6c6 service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:09.177440 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:09.178530 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:09.178769 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:09.179037 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:09.181091 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:13:09.195914 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:09.197733 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:09.213920 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1472/2941] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 13:13:09.229790 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:09.308353 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b29d-4e04-48d2-8a9d-51b2f57e548c service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:09.313155 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:09.313856 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:09.314133 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:09.314408 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] PATH_INFO: `/v3/users/364cd6e55c32470b9c3b4c58896a948c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:09.315548 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364cd6e55c32470b9c3b4c58896a948c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:09.317505 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:09.364770 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364cd6e55c32470b9c3b4c58896a948c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.373205 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364cd6e55c32470b9c3b4c58896a948c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.374119 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364cd6e55c32470b9c3b4c58896a948c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.388104 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364cd6e55c32470b9c3b4c58896a948c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.395943 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364cd6e55c32470b9c3b4c58896a948c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.402642 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1470/2942] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:13:09 2022] DELETE /identity/v3/users/364cd6e55c32470b9c3b4c58896a948c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:13:09.618537 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:09.640670 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04712a5-eca2-4abd-93d6-17128cf2e179 service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:09.709781 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:09.710424 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:09.710786 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:09.710986 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] PATH_INFO: `/v3/projects/394ac30983e848c697736df1907f8c39` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:09.712207 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=394ac30983e848c697736df1907f8c39)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:09.714225 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:09.774187 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394ac30983e848c697736df1907f8c39', 'request_id': 'req-cc18519a-eecf-4a4e-b857-f21a7313cabb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.783508 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394ac30983e848c697736df1907f8c39', 'request_id': 'req-cc18519a-eecf-4a4e-b857-f21a7313cabb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.791714 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394ac30983e848c697736df1907f8c39', 'request_id': 'req-cc18519a-eecf-4a4e-b857-f21a7313cabb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.803979 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] The token cache is being invalidate because project 394ac30983e848c697736df1907f8c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:13:09.804273 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.804947 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.806507 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1473/2943] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:13:09 2022] DELETE /identity/v3/projects/394ac30983e848c697736df1907f8c39 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:13:09.811633 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:09.813107 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:13:09.828784 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec9ea-5eb0-423e-983d-502272a891c0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:09.879003 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:09.890064 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:09.890861 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:09.891343 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:09.891612 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] PATH_INFO: `/v3/users/15d9d56de3b04ae99bca1da9c97339b8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:09.892782 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d9d56de3b04ae99bca1da9c97339b8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:09.894732 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:09.943639 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d9d56de3b04ae99bca1da9c97339b8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.950694 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d9d56de3b04ae99bca1da9c97339b8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.951302 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d9d56de3b04ae99bca1da9c97339b8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.962991 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d9d56de3b04ae99bca1da9c97339b8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.969771 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d9d56de3b04ae99bca1da9c97339b8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:09.975478 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1471/2944] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 13:13:09 2022] DELETE /identity/v3/users/15d9d56de3b04ae99bca1da9c97339b8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:13:10.160594 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:13:10.162204 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:13:10.176472 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18519a-eecf-4a4e-b857-f21a7313cabb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:13:10.244564 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6635e8dd81449693cd6bc25f154f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb4fc2fc9f544519a9c90c5e72e0d4c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:13:10.245205 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:13:10.245534 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:13:10.245805 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] PATH_INFO: `/v3/projects/936907d4d18e47b580a7bd6ae31305b9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:13:10.247077 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=936907d4d18e47b580a7bd6ae31305b9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:13:10.248981 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:13:10.255784 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:10.304402 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936907d4d18e47b580a7bd6ae31305b9', 'request_id': 'req-66997b95-bbf6-4371-9157-651c0e41e7fc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:10.313108 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936907d4d18e47b580a7bd6ae31305b9', 'request_id': 'req-66997b95-bbf6-4371-9157-651c0e41e7fc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:10.319968 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936907d4d18e47b580a7bd6ae31305b9', 'request_id': 'req-66997b95-bbf6-4371-9157-651c0e41e7fc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:10.333666 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] The token cache is being invalidate because project 936907d4d18e47b580a7bd6ae31305b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 13:13:10.333962 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:10.334640 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66997b95-bbf6-4371-9157-651c0e41e7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 13:13:10.340586 dv-cinder-854428-2-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1474/2945] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 13:13:10 2022] DELETE /identity/v3/projects/936907d4d18e47b580a7bd6ae31305b9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 13:13:19.972148 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:20.329929 dv-cinder-854428-2-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:05.099237 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 13:18:05.100697 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:18:05.248021 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd890-e0fe-451f-8ba9-5133f0c8ede5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 13:18:05.312521 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '458dde7e70e746ef9a69f0e8afca9602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5293034f3e9e474e9139f94a9e9f9b6e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 13:18:05.313128 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 13:18:05.313410 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 13:18:05.313716 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 13:18:05.315503 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 13:18:05.331763 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 13:18:05.337305 dv-cinder-854428-2-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbad87-c19a-4fac-8f55-fa58c8d09057 service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 13:18:05.348127 dv-cinder-854428-2-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1472/2946] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)